2023-02-18 15:00:53,174 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-18 15:00:53,227 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=237, ProcessCount=171, AvailableMemoryMB=11011 2023-02-18 15:00:53,517 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319 2023-02-18 15:00:53,525 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 15:00:53,525 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/cluster_9c5c8fe6-0cae-5d31-f576-c14feeac25e8, deleteOnExit=true 2023-02-18 15:00:53,526 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 15:00:53,526 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/test.cache.data in system properties and HBase conf 2023-02-18 15:00:53,526 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 15:00:53,527 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/hadoop.log.dir in system properties and HBase conf 2023-02-18 15:00:53,527 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 15:00:53,528 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 15:00:53,528 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 15:00:53,649 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-18 15:00:54,075 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 15:00:54,080 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:00:54,080 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:00:54,081 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 15:00:54,081 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:00:54,081 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 15:00:54,082 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 15:00:54,082 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:00:54,082 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:00:54,082 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 15:00:54,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/nfs.dump.dir in system properties and HBase conf 2023-02-18 15:00:54,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/java.io.tmpdir in system properties and HBase conf 2023-02-18 15:00:54,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:00:54,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 15:00:54,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 15:00:54,591 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:00:54,595 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:00:54,947 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-18 15:00:55,152 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-18 15:00:55,170 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:00:55,216 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:00:55,257 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/java.io.tmpdir/Jetty_localhost_42273_hdfs____j0uaka/webapp 2023-02-18 15:00:55,416 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42273 2023-02-18 15:00:55,454 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:00:55,454 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:00:55,985 WARN [Listener at localhost/37253] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:00:56,067 WARN [Listener at localhost/37253] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:00:56,090 WARN [Listener at localhost/37253] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:00:56,099 INFO [Listener at localhost/37253] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:00:56,108 INFO [Listener at localhost/37253] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/java.io.tmpdir/Jetty_localhost_42821_datanode____w2ny5c/webapp 2023-02-18 15:00:56,288 INFO [Listener at localhost/37253] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42821 2023-02-18 15:00:56,736 WARN [Listener at localhost/46013] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:00:56,787 WARN [Listener at localhost/46013] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:00:56,792 WARN [Listener at localhost/46013] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:00:56,794 INFO [Listener at localhost/46013] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:00:56,805 INFO [Listener at localhost/46013] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/java.io.tmpdir/Jetty_localhost_42161_datanode____.xtzwyz/webapp 2023-02-18 15:00:56,911 INFO [Listener at localhost/46013] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42161 2023-02-18 15:00:56,924 WARN [Listener at localhost/42771] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:00:57,352 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x426546e8b14c868e: Processing first storage report for DS-430a943a-7212-41ce-bb64-9de69103d63f from datanode 53275d4e-8370-4ffa-97bf-e416c2fef931 2023-02-18 15:00:57,354 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x426546e8b14c868e: from storage DS-430a943a-7212-41ce-bb64-9de69103d63f node DatanodeRegistration(127.0.0.1:41889, datanodeUuid=53275d4e-8370-4ffa-97bf-e416c2fef931, infoPort=44839, infoSecurePort=0, ipcPort=46013, storageInfo=lv=-57;cid=testClusterID;nsid=1214018454;c=1676732454695), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-18 15:00:57,354 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0b1dc4e069dc5cc: Processing first storage report for DS-83b5f32b-7bcb-4b18-b69c-19f0ab0050a0 from datanode 5a61b471-68da-497b-ab77-217fd70cf129 2023-02-18 15:00:57,355 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0b1dc4e069dc5cc: from storage DS-83b5f32b-7bcb-4b18-b69c-19f0ab0050a0 node DatanodeRegistration(127.0.0.1:33341, datanodeUuid=5a61b471-68da-497b-ab77-217fd70cf129, infoPort=45405, infoSecurePort=0, ipcPort=42771, storageInfo=lv=-57;cid=testClusterID;nsid=1214018454;c=1676732454695), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 15:00:57,355 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x426546e8b14c868e: Processing first storage report for DS-610cffe3-7667-4278-a92c-cfa617583d50 from datanode 53275d4e-8370-4ffa-97bf-e416c2fef931 2023-02-18 15:00:57,355 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x426546e8b14c868e: from storage DS-610cffe3-7667-4278-a92c-cfa617583d50 node DatanodeRegistration(127.0.0.1:41889, datanodeUuid=53275d4e-8370-4ffa-97bf-e416c2fef931, infoPort=44839, infoSecurePort=0, ipcPort=46013, storageInfo=lv=-57;cid=testClusterID;nsid=1214018454;c=1676732454695), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:00:57,355 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0b1dc4e069dc5cc: Processing first storage report for DS-be99d105-90f0-4aa4-9516-246337844a10 from datanode 5a61b471-68da-497b-ab77-217fd70cf129 2023-02-18 15:00:57,355 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0b1dc4e069dc5cc: from storage DS-be99d105-90f0-4aa4-9516-246337844a10 node DatanodeRegistration(127.0.0.1:33341, datanodeUuid=5a61b471-68da-497b-ab77-217fd70cf129, infoPort=45405, infoSecurePort=0, ipcPort=42771, storageInfo=lv=-57;cid=testClusterID;nsid=1214018454;c=1676732454695), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:00:57,454 DEBUG [Listener at localhost/42771] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319 2023-02-18 15:00:57,555 INFO [Listener at localhost/42771] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/cluster_9c5c8fe6-0cae-5d31-f576-c14feeac25e8/zookeeper_0, clientPort=63142, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/cluster_9c5c8fe6-0cae-5d31-f576-c14feeac25e8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/cluster_9c5c8fe6-0cae-5d31-f576-c14feeac25e8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 15:00:57,579 INFO [Listener at localhost/42771] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63142 2023-02-18 15:00:57,590 INFO [Listener at localhost/42771] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:00:57,592 INFO [Listener at localhost/42771] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:00:58,263 INFO [Listener at localhost/42771] util.FSUtils(479): Created version file at hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3 with version=8 2023-02-18 15:00:58,264 INFO [Listener at localhost/42771] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:00:58,265 INFO [Listener at localhost/42771] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:00:58,268 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/hbase-staging 2023-02-18 15:00:58,597 INFO [Listener at localhost/42771] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-18 15:00:59,056 INFO [Listener at localhost/42771] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:00:59,089 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:00:59,089 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:00:59,090 INFO [Listener at localhost/42771] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:00:59,090 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:00:59,090 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:00:59,236 INFO [Listener at localhost/42771] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:00:59,318 DEBUG [Listener at localhost/42771] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-18 15:00:59,410 INFO [Listener at localhost/42771] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39419 2023-02-18 15:00:59,421 INFO [Listener at localhost/42771] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:00:59,423 INFO [Listener at localhost/42771] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:00:59,447 INFO [Listener at localhost/42771] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39419 connecting to ZooKeeper ensemble=127.0.0.1:63142 2023-02-18 15:00:59,504 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:394190x0, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:00:59,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39419-0x10067f2cc040000 connected 2023-02-18 15:00:59,542 DEBUG [Listener at localhost/42771] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:00:59,543 DEBUG [Listener at localhost/42771] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:00:59,547 DEBUG [Listener at localhost/42771] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:00:59,554 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39419 2023-02-18 15:00:59,555 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39419 2023-02-18 15:00:59,555 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39419 2023-02-18 15:00:59,556 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39419 2023-02-18 15:00:59,556 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39419 2023-02-18 15:00:59,562 INFO [Listener at localhost/42771] master.HMaster(444): hbase.rootdir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3, hbase.cluster.distributed=false 2023-02-18 15:00:59,630 INFO [Listener at localhost/42771] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:00:59,630 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:00:59,631 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:00:59,631 INFO [Listener at localhost/42771] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:00:59,631 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:00:59,631 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:00:59,636 INFO [Listener at localhost/42771] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:00:59,639 INFO [Listener at localhost/42771] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46385 2023-02-18 15:00:59,641 INFO [Listener at localhost/42771] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:00:59,648 DEBUG [Listener at localhost/42771] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:00:59,649 INFO [Listener at localhost/42771] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:00:59,651 INFO [Listener at localhost/42771] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:00:59,652 INFO [Listener at localhost/42771] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46385 connecting to ZooKeeper ensemble=127.0.0.1:63142 2023-02-18 15:00:59,656 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:463850x0, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:00:59,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46385-0x10067f2cc040001 connected 2023-02-18 15:00:59,657 DEBUG [Listener at localhost/42771] zookeeper.ZKUtil(164): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:00:59,658 DEBUG [Listener at localhost/42771] zookeeper.ZKUtil(164): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:00:59,659 DEBUG [Listener at localhost/42771] zookeeper.ZKUtil(164): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:00:59,660 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46385 2023-02-18 15:00:59,660 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46385 2023-02-18 15:00:59,664 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46385 2023-02-18 15:00:59,668 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46385 2023-02-18 15:00:59,668 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46385 2023-02-18 15:00:59,681 INFO [Listener at localhost/42771] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:00:59,681 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:00:59,682 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:00:59,682 INFO [Listener at localhost/42771] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:00:59,682 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:00:59,683 INFO [Listener at localhost/42771] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:00:59,683 INFO [Listener at localhost/42771] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:00:59,685 INFO [Listener at localhost/42771] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46721 2023-02-18 15:00:59,685 INFO [Listener at localhost/42771] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:00:59,688 DEBUG [Listener at localhost/42771] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:00:59,689 INFO [Listener at localhost/42771] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:00:59,691 INFO [Listener at localhost/42771] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:00:59,693 INFO [Listener at localhost/42771] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46721 connecting to ZooKeeper ensemble=127.0.0.1:63142 2023-02-18 15:00:59,698 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:467210x0, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:00:59,700 DEBUG [Listener at localhost/42771] zookeeper.ZKUtil(164): regionserver:467210x0, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:00:59,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46721-0x10067f2cc040002 connected 2023-02-18 15:00:59,701 DEBUG [Listener at localhost/42771] zookeeper.ZKUtil(164): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:00:59,701 DEBUG [Listener at localhost/42771] zookeeper.ZKUtil(164): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:00:59,704 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46721 2023-02-18 15:00:59,704 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46721 2023-02-18 15:00:59,704 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46721 2023-02-18 15:00:59,708 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46721 2023-02-18 15:00:59,710 DEBUG [Listener at localhost/42771] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46721 2023-02-18 15:00:59,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39419,1676732458422 2023-02-18 15:00:59,725 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:00:59,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39419,1676732458422 2023-02-18 15:00:59,753 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:00:59,754 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:00:59,754 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:00:59,754 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:00:59,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:00:59,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39419,1676732458422 from backup master directory 2023-02-18 15:00:59,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:00:59,761 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39419,1676732458422 2023-02-18 15:00:59,761 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:00:59,762 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:00:59,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39419,1676732458422 2023-02-18 15:00:59,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-18 15:00:59,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-18 15:00:59,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/hbase.id with ID: ba7548c7-c73e-48d2-b4aa-da882556036f 2023-02-18 15:00:59,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:00:59,911 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:00:59,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7247152e to 127.0.0.1:63142 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:00:59,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dc9e5b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:00,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:00,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 15:01:00,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-18 15:01:00,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-18 15:01:00,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-18 15:01:00,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-18 15:01:00,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:00,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/data/master/store-tmp 2023-02-18 15:01:00,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:00,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:00,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:00,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:00,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:00,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:00,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:00,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:00,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/WALs/jenkins-hbase4.apache.org,39419,1676732458422 2023-02-18 15:01:00,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39419%2C1676732458422, suffix=, logDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/WALs/jenkins-hbase4.apache.org,39419,1676732458422, archiveDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/oldWALs, maxLogs=10 2023-02-18 15:01:00,201 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41889,DS-430a943a-7212-41ce-bb64-9de69103d63f,DISK] 2023-02-18 15:01:00,201 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-83b5f32b-7bcb-4b18-b69c-19f0ab0050a0,DISK] 2023-02-18 15:01:00,209 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-18 15:01:00,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/WALs/jenkins-hbase4.apache.org,39419,1676732458422/jenkins-hbase4.apache.org%2C39419%2C1676732458422.1676732460153 2023-02-18 15:01:00,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33341,DS-83b5f32b-7bcb-4b18-b69c-19f0ab0050a0,DISK], DatanodeInfoWithStorage[127.0.0.1:41889,DS-430a943a-7212-41ce-bb64-9de69103d63f,DISK]] 2023-02-18 15:01:00,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:00,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:00,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:00,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:00,346 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:00,353 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 15:01:00,379 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 15:01:00,391 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:00,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:00,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:00,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:00,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:00,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72585651, jitterRate=0.08161048591136932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:00,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:00,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 15:01:00,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 15:01:00,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 15:01:00,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 15:01:00,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-18 15:01:00,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-18 15:01:00,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 15:01:00,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 15:01:00,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 15:01:00,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 15:01:00,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 15:01:00,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 15:01:00,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 15:01:00,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 15:01:00,562 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:00,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 15:01:00,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 15:01:00,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 15:01:00,588 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:00,588 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:00,588 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:00,588 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:00,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39419,1676732458422, sessionid=0x10067f2cc040000, setting cluster-up flag (Was=false) 2023-02-18 15:01:00,612 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:00,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 15:01:00,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39419,1676732458422 2023-02-18 15:01:00,628 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:00,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 15:01:00,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39419,1676732458422 2023-02-18 15:01:00,638 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.hbase-snapshot/.tmp 2023-02-18 15:01:00,715 INFO [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer(952): ClusterId : ba7548c7-c73e-48d2-b4aa-da882556036f 2023-02-18 15:01:00,717 INFO [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(952): ClusterId : ba7548c7-c73e-48d2-b4aa-da882556036f 2023-02-18 15:01:00,725 DEBUG [RS:1;jenkins-hbase4:46721] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:00,725 DEBUG [RS:0;jenkins-hbase4:46385] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:00,734 DEBUG [RS:0;jenkins-hbase4:46385] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:00,734 DEBUG [RS:1;jenkins-hbase4:46721] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:00,734 DEBUG [RS:0;jenkins-hbase4:46385] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:00,734 DEBUG [RS:1;jenkins-hbase4:46721] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:00,737 DEBUG [RS:1;jenkins-hbase4:46721] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:00,737 DEBUG [RS:0;jenkins-hbase4:46385] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:00,739 DEBUG [RS:1;jenkins-hbase4:46721] zookeeper.ReadOnlyZKClient(139): Connect 0x13d61333 to 127.0.0.1:63142 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:00,739 DEBUG [RS:0;jenkins-hbase4:46385] zookeeper.ReadOnlyZKClient(139): Connect 0x012c8b98 to 127.0.0.1:63142 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:00,746 DEBUG [RS:1;jenkins-hbase4:46721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d11ef39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:00,746 DEBUG [RS:0;jenkins-hbase4:46385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@feb75cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:00,746 DEBUG [RS:1;jenkins-hbase4:46721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@192e7843, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:00,747 DEBUG [RS:0;jenkins-hbase4:46385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bd4e0e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:00,770 DEBUG [RS:0;jenkins-hbase4:46385] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46385 2023-02-18 15:01:00,773 DEBUG [RS:1;jenkins-hbase4:46721] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46721 2023-02-18 15:01:00,776 INFO [RS:0;jenkins-hbase4:46385] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:00,776 INFO [RS:1;jenkins-hbase4:46721] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:00,776 INFO [RS:1;jenkins-hbase4:46721] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:00,776 INFO [RS:0;jenkins-hbase4:46385] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:00,777 DEBUG [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:00,777 DEBUG [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:00,780 INFO [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39419,1676732458422 with isa=jenkins-hbase4.apache.org/172.31.14.131:46385, startcode=1676732459629 2023-02-18 15:01:00,780 INFO [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39419,1676732458422 with isa=jenkins-hbase4.apache.org/172.31.14.131:46721, startcode=1676732459680 2023-02-18 15:01:00,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:00,810 DEBUG [RS:1;jenkins-hbase4:46721] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:00,816 DEBUG [RS:0;jenkins-hbase4:46385] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:00,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:00,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:00,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:00,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:00,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 15:01:00,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:00,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:00,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:00,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676732490835 2023-02-18 15:01:00,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 15:01:00,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 15:01:00,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 15:01:00,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 15:01:00,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 15:01:00,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 15:01:00,863 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:00,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:00,864 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 15:01:00,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 15:01:00,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 15:01:00,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 15:01:00,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 15:01:00,871 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:00,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 15:01:00,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732460873,5,FailOnTimeoutGroup] 2023-02-18 15:01:00,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732460874,5,FailOnTimeoutGroup] 2023-02-18 15:01:00,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:00,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 15:01:00,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:00,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:00,881 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33245, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:00,881 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49929, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:00,895 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:00,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39419] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:00,909 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:00,911 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:00,911 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3 2023-02-18 15:01:00,917 DEBUG [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3 2023-02-18 15:01:00,917 DEBUG [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3 2023-02-18 15:01:00,917 DEBUG [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37253 2023-02-18 15:01:00,918 DEBUG [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37253 2023-02-18 15:01:00,918 DEBUG [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:00,918 DEBUG [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:00,929 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:00,930 DEBUG [RS:1;jenkins-hbase4:46721] zookeeper.ZKUtil(162): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:00,930 DEBUG [RS:0;jenkins-hbase4:46385] zookeeper.ZKUtil(162): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:00,931 WARN [RS:1;jenkins-hbase4:46721] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:00,931 WARN [RS:0;jenkins-hbase4:46385] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:00,931 INFO [RS:0;jenkins-hbase4:46385] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:00,931 INFO [RS:1;jenkins-hbase4:46721] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:00,932 DEBUG [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/WALs/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:00,932 DEBUG [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/WALs/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:00,932 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46721,1676732459680] 2023-02-18 15:01:00,933 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46385,1676732459629] 2023-02-18 15:01:00,934 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:00,940 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:00,943 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/info 2023-02-18 15:01:00,944 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:00,945 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:00,945 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:00,945 DEBUG [RS:0;jenkins-hbase4:46385] zookeeper.ZKUtil(162): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:00,945 DEBUG [RS:1;jenkins-hbase4:46721] zookeeper.ZKUtil(162): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:00,946 DEBUG [RS:0;jenkins-hbase4:46385] zookeeper.ZKUtil(162): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:00,946 DEBUG [RS:1;jenkins-hbase4:46721] zookeeper.ZKUtil(162): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:00,948 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:00,949 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:00,950 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:00,950 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:00,952 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/table 2023-02-18 15:01:00,953 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:00,954 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:00,956 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740 2023-02-18 15:01:00,957 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740 2023-02-18 15:01:00,960 DEBUG [RS:0;jenkins-hbase4:46385] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:00,960 DEBUG [RS:1;jenkins-hbase4:46721] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:00,963 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:00,965 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:00,970 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:00,971 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63444038, jitterRate=-0.05461016297340393}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:00,971 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:00,971 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:00,971 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:00,971 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:00,971 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:00,971 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:00,972 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:00,972 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:00,973 INFO [RS:1;jenkins-hbase4:46721] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:00,973 INFO [RS:0;jenkins-hbase4:46385] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:00,979 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:00,979 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 15:01:00,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 15:01:00,996 INFO [RS:1;jenkins-hbase4:46721] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:00,996 INFO [RS:0;jenkins-hbase4:46385] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:01,000 INFO [RS:0;jenkins-hbase4:46385] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:01,000 INFO [RS:1;jenkins-hbase4:46721] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:01,001 INFO [RS:0;jenkins-hbase4:46385] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,001 INFO [RS:1;jenkins-hbase4:46721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,002 INFO [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:01,002 INFO [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:01,010 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 15:01:01,013 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 15:01:01,013 INFO [RS:0;jenkins-hbase4:46385] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,013 INFO [RS:1;jenkins-hbase4:46721] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,014 DEBUG [RS:0;jenkins-hbase4:46385] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,014 DEBUG [RS:1;jenkins-hbase4:46721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,014 DEBUG [RS:0;jenkins-hbase4:46385] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,014 DEBUG [RS:1;jenkins-hbase4:46721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,014 DEBUG [RS:0;jenkins-hbase4:46385] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,014 DEBUG [RS:1;jenkins-hbase4:46721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,014 DEBUG [RS:0;jenkins-hbase4:46385] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,015 DEBUG [RS:1;jenkins-hbase4:46721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,015 DEBUG [RS:0;jenkins-hbase4:46385] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,015 DEBUG [RS:1;jenkins-hbase4:46721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,015 DEBUG [RS:0;jenkins-hbase4:46385] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:01,015 DEBUG [RS:1;jenkins-hbase4:46721] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:01,015 DEBUG [RS:0;jenkins-hbase4:46385] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,015 DEBUG [RS:1;jenkins-hbase4:46721] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,015 DEBUG [RS:0;jenkins-hbase4:46385] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,015 DEBUG [RS:1;jenkins-hbase4:46721] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,015 DEBUG [RS:0;jenkins-hbase4:46385] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,015 DEBUG [RS:1;jenkins-hbase4:46721] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,015 DEBUG [RS:0;jenkins-hbase4:46385] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,015 DEBUG [RS:1;jenkins-hbase4:46721] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:01,021 INFO [RS:0;jenkins-hbase4:46385] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,021 INFO [RS:0;jenkins-hbase4:46385] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,021 INFO [RS:0;jenkins-hbase4:46385] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,021 INFO [RS:1;jenkins-hbase4:46721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,021 INFO [RS:1;jenkins-hbase4:46721] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,021 INFO [RS:1;jenkins-hbase4:46721] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,042 INFO [RS:1;jenkins-hbase4:46721] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:01,042 INFO [RS:0;jenkins-hbase4:46385] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:01,046 INFO [RS:1;jenkins-hbase4:46721] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46721,1676732459680-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,046 INFO [RS:0;jenkins-hbase4:46385] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46385,1676732459629-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,071 INFO [RS:1;jenkins-hbase4:46721] regionserver.Replication(203): jenkins-hbase4.apache.org,46721,1676732459680 started 2023-02-18 15:01:01,071 INFO [RS:0;jenkins-hbase4:46385] regionserver.Replication(203): jenkins-hbase4.apache.org,46385,1676732459629 started 2023-02-18 15:01:01,071 INFO [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46721,1676732459680, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46721, sessionid=0x10067f2cc040002 2023-02-18 15:01:01,071 INFO [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46385,1676732459629, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46385, sessionid=0x10067f2cc040001 2023-02-18 15:01:01,072 DEBUG [RS:1;jenkins-hbase4:46721] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:01,072 DEBUG [RS:0;jenkins-hbase4:46385] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:01,072 DEBUG [RS:1;jenkins-hbase4:46721] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:01,072 DEBUG [RS:0;jenkins-hbase4:46385] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:01,073 DEBUG [RS:1;jenkins-hbase4:46721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46721,1676732459680' 2023-02-18 15:01:01,073 DEBUG [RS:0;jenkins-hbase4:46385] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46385,1676732459629' 2023-02-18 15:01:01,073 DEBUG [RS:0;jenkins-hbase4:46385] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:01,073 DEBUG [RS:1;jenkins-hbase4:46721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:01,074 DEBUG [RS:1;jenkins-hbase4:46721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:01,074 DEBUG [RS:0;jenkins-hbase4:46385] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:01,075 DEBUG [RS:1;jenkins-hbase4:46721] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:01,075 DEBUG [RS:0;jenkins-hbase4:46385] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:01,075 DEBUG [RS:1;jenkins-hbase4:46721] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:01,075 DEBUG [RS:0;jenkins-hbase4:46385] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:01,075 DEBUG [RS:1;jenkins-hbase4:46721] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:01,075 DEBUG [RS:0;jenkins-hbase4:46385] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:01,076 DEBUG [RS:0;jenkins-hbase4:46385] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46385,1676732459629' 2023-02-18 15:01:01,076 DEBUG [RS:0;jenkins-hbase4:46385] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:01,076 DEBUG [RS:1;jenkins-hbase4:46721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46721,1676732459680' 2023-02-18 15:01:01,076 DEBUG [RS:1;jenkins-hbase4:46721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:01,077 DEBUG [RS:0;jenkins-hbase4:46385] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:01,077 DEBUG [RS:1;jenkins-hbase4:46721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:01,077 DEBUG [RS:0;jenkins-hbase4:46385] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:01,077 INFO [RS:0;jenkins-hbase4:46385] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:01,077 DEBUG [RS:1;jenkins-hbase4:46721] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:01,078 INFO [RS:0;jenkins-hbase4:46385] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:01,078 INFO [RS:1;jenkins-hbase4:46721] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:01,078 INFO [RS:1;jenkins-hbase4:46721] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:01,166 DEBUG [jenkins-hbase4:39419] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 15:01:01,172 DEBUG [jenkins-hbase4:39419] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:01,180 DEBUG [jenkins-hbase4:39419] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:01,180 DEBUG [jenkins-hbase4:39419] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:01,180 DEBUG [jenkins-hbase4:39419] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:01,183 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46721,1676732459680, state=OPENING 2023-02-18 15:01:01,190 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 15:01:01,192 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:01,192 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:01,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:01,381 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:01,384 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:01,387 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36226, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:01,400 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 15:01:01,400 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:01,404 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46721%2C1676732459680.meta, suffix=.meta, logDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/WALs/jenkins-hbase4.apache.org,46721,1676732459680, archiveDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/oldWALs, maxLogs=32 2023-02-18 15:01:01,433 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-83b5f32b-7bcb-4b18-b69c-19f0ab0050a0,DISK] 2023-02-18 15:01:01,434 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41889,DS-430a943a-7212-41ce-bb64-9de69103d63f,DISK] 2023-02-18 15:01:01,439 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/WALs/jenkins-hbase4.apache.org,46721,1676732459680/jenkins-hbase4.apache.org%2C46721%2C1676732459680.meta.1676732461408.meta 2023-02-18 15:01:01,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33341,DS-83b5f32b-7bcb-4b18-b69c-19f0ab0050a0,DISK], DatanodeInfoWithStorage[127.0.0.1:41889,DS-430a943a-7212-41ce-bb64-9de69103d63f,DISK]] 2023-02-18 15:01:01,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:01,442 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 15:01:01,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 15:01:01,464 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 15:01:01,470 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 15:01:01,470 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:01,470 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 15:01:01,470 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 15:01:01,473 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:01,475 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/info 2023-02-18 15:01:01,476 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/info 2023-02-18 15:01:01,476 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:01,478 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:01,478 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:01,479 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:01,479 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:01,480 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:01,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:01,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:01,483 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/table 2023-02-18 15:01:01,483 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/table 2023-02-18 15:01:01,483 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:01,484 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:01,486 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740 2023-02-18 15:01:01,489 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740 2023-02-18 15:01:01,492 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:01,496 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:01,497 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59544720, jitterRate=-0.11271452903747559}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:01,498 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:01,511 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676732461373 2023-02-18 15:01:01,530 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 15:01:01,531 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 15:01:01,531 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46721,1676732459680, state=OPEN 2023-02-18 15:01:01,536 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 15:01:01,536 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:01,540 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 15:01:01,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46721,1676732459680 in 340 msec 2023-02-18 15:01:01,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 15:01:01,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 551 msec 2023-02-18 15:01:01,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 847 msec 2023-02-18 15:01:01,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676732461551, completionTime=-1 2023-02-18 15:01:01,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 15:01:01,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 15:01:01,620 DEBUG [hconnection-0x6fd32655-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:01,623 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36236, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:01,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 15:01:01,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676732521640 2023-02-18 15:01:01,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676732581641 2023-02-18 15:01:01,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 89 msec 2023-02-18 15:01:01,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39419,1676732458422-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39419,1676732458422-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39419,1676732458422-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39419, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:01,673 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 15:01:01,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 15:01:01,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:01,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 15:01:01,695 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:01,698 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:01,720 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7 2023-02-18 15:01:01,723 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7 empty. 2023-02-18 15:01:01,724 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7 2023-02-18 15:01:01,724 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 15:01:01,756 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:01,759 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8df8d0445c3895bf8f636e81111e36c7, NAME => 'hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp 2023-02-18 15:01:01,784 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:01,784 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8df8d0445c3895bf8f636e81111e36c7, disabling compactions & flushes 2023-02-18 15:01:01,784 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:01,784 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:01,784 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. after waiting 0 ms 2023-02-18 15:01:01,784 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:01,784 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:01,785 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8df8d0445c3895bf8f636e81111e36c7: 2023-02-18 15:01:01,790 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:01,808 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732461793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732461793"}]},"ts":"1676732461793"} 2023-02-18 15:01:01,846 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 15:01:01,848 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:01,855 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732461849"}]},"ts":"1676732461849"} 2023-02-18 15:01:01,862 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 15:01:01,869 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:01,872 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:01,872 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:01,872 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:01,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8df8d0445c3895bf8f636e81111e36c7, ASSIGN}] 2023-02-18 15:01:01,880 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8df8d0445c3895bf8f636e81111e36c7, ASSIGN 2023-02-18 15:01:01,882 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8df8d0445c3895bf8f636e81111e36c7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46721,1676732459680; forceNewPlan=false, retain=false 2023-02-18 15:01:02,034 INFO [jenkins-hbase4:39419] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 15:01:02,035 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8df8d0445c3895bf8f636e81111e36c7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:02,036 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732462035"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732462035"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732462035"}]},"ts":"1676732462035"} 2023-02-18 15:01:02,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8df8d0445c3895bf8f636e81111e36c7, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:02,089 INFO [RS:0;jenkins-hbase4:46385] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46385%2C1676732459629, suffix=, logDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/WALs/jenkins-hbase4.apache.org,46385,1676732459629, archiveDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/oldWALs, maxLogs=32 2023-02-18 15:01:02,089 INFO [RS:1;jenkins-hbase4:46721] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46721%2C1676732459680, suffix=, logDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/WALs/jenkins-hbase4.apache.org,46721,1676732459680, archiveDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/oldWALs, maxLogs=32 2023-02-18 15:01:02,109 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-83b5f32b-7bcb-4b18-b69c-19f0ab0050a0,DISK] 2023-02-18 15:01:02,110 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41889,DS-430a943a-7212-41ce-bb64-9de69103d63f,DISK] 2023-02-18 15:01:02,112 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-83b5f32b-7bcb-4b18-b69c-19f0ab0050a0,DISK] 2023-02-18 15:01:02,112 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41889,DS-430a943a-7212-41ce-bb64-9de69103d63f,DISK] 2023-02-18 15:01:02,148 INFO [RS:1;jenkins-hbase4:46721] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/WALs/jenkins-hbase4.apache.org,46721,1676732459680/jenkins-hbase4.apache.org%2C46721%2C1676732459680.1676732462091 2023-02-18 15:01:02,148 INFO [RS:0;jenkins-hbase4:46385] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/WALs/jenkins-hbase4.apache.org,46385,1676732459629/jenkins-hbase4.apache.org%2C46385%2C1676732459629.1676732462091 2023-02-18 15:01:02,148 DEBUG [RS:1;jenkins-hbase4:46721] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33341,DS-83b5f32b-7bcb-4b18-b69c-19f0ab0050a0,DISK], DatanodeInfoWithStorage[127.0.0.1:41889,DS-430a943a-7212-41ce-bb64-9de69103d63f,DISK]] 2023-02-18 15:01:02,152 DEBUG [RS:0;jenkins-hbase4:46385] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33341,DS-83b5f32b-7bcb-4b18-b69c-19f0ab0050a0,DISK], DatanodeInfoWithStorage[127.0.0.1:41889,DS-430a943a-7212-41ce-bb64-9de69103d63f,DISK]] 2023-02-18 15:01:02,200 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:02,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8df8d0445c3895bf8f636e81111e36c7, NAME => 'hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:02,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8df8d0445c3895bf8f636e81111e36c7 2023-02-18 15:01:02,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:02,202 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8df8d0445c3895bf8f636e81111e36c7 2023-02-18 15:01:02,202 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8df8d0445c3895bf8f636e81111e36c7 2023-02-18 15:01:02,204 INFO [StoreOpener-8df8d0445c3895bf8f636e81111e36c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8df8d0445c3895bf8f636e81111e36c7 2023-02-18 15:01:02,206 DEBUG [StoreOpener-8df8d0445c3895bf8f636e81111e36c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7/info 2023-02-18 15:01:02,206 DEBUG [StoreOpener-8df8d0445c3895bf8f636e81111e36c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7/info 2023-02-18 15:01:02,207 INFO [StoreOpener-8df8d0445c3895bf8f636e81111e36c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8df8d0445c3895bf8f636e81111e36c7 columnFamilyName info 2023-02-18 15:01:02,208 INFO [StoreOpener-8df8d0445c3895bf8f636e81111e36c7-1] regionserver.HStore(310): Store=8df8d0445c3895bf8f636e81111e36c7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:02,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7 2023-02-18 15:01:02,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7 2023-02-18 15:01:02,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8df8d0445c3895bf8f636e81111e36c7 2023-02-18 15:01:02,218 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:02,219 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8df8d0445c3895bf8f636e81111e36c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62345713, jitterRate=-0.07097648084163666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:02,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8df8d0445c3895bf8f636e81111e36c7: 2023-02-18 15:01:02,223 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7., pid=6, masterSystemTime=1676732462193 2023-02-18 15:01:02,227 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:02,227 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:02,229 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8df8d0445c3895bf8f636e81111e36c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:02,229 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732462228"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732462228"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732462228"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732462228"}]},"ts":"1676732462228"} 2023-02-18 15:01:02,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 15:01:02,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8df8d0445c3895bf8f636e81111e36c7, server=jenkins-hbase4.apache.org,46721,1676732459680 in 193 msec 2023-02-18 15:01:02,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 15:01:02,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8df8d0445c3895bf8f636e81111e36c7, ASSIGN in 362 msec 2023-02-18 15:01:02,243 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:02,243 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732462243"}]},"ts":"1676732462243"} 2023-02-18 15:01:02,247 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 15:01:02,250 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:02,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 566 msec 2023-02-18 15:01:02,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 15:01:02,297 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:02,297 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:02,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 15:01:02,361 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:02,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-02-18 15:01:02,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 15:01:02,386 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:02,391 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-18 15:01:02,402 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 15:01:02,404 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 15:01:02,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.643sec 2023-02-18 15:01:02,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 15:01:02,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 15:01:02,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 15:01:02,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39419,1676732458422-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 15:01:02,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39419,1676732458422-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 15:01:02,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 15:01:02,448 DEBUG [Listener at localhost/42771] zookeeper.ReadOnlyZKClient(139): Connect 0x1643fa82 to 127.0.0.1:63142 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:02,452 DEBUG [Listener at localhost/42771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66ba8a8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:02,507 DEBUG [hconnection-0x4a1aa3d8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:02,525 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36238, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:02,535 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39419,1676732458422 2023-02-18 15:01:02,535 DEBUG [Listener at localhost/42771] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 15:01:02,545 DEBUG [Listener at localhost/42771] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 15:01:02,547 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45402, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 15:01:02,553 INFO [Listener at localhost/42771] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 15:01:02,558 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-18 15:01:02,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 15:01:02,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:45402 deadline: 1676732522557, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-18 15:01:02,580 INFO [Listener at localhost/42771] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-18 15:01:02,596 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:02,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-18 15:01:02,602 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:02,604 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:02,608 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-18 15:01:02,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:02,627 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:02,627 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:02,627 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:02,628 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:02,628 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:02,629 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134 empty. 2023-02-18 15:01:02,629 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:02,629 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:02,629 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:02,629 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90 empty. 2023-02-18 15:01:02,629 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3 empty. 2023-02-18 15:01:02,630 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983 empty. 2023-02-18 15:01:02,631 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430 empty. 2023-02-18 15:01:02,631 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c empty. 2023-02-18 15:01:02,631 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:02,632 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:02,632 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:02,632 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:02,632 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:02,633 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b empty. 2023-02-18 15:01:02,633 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a empty. 2023-02-18 15:01:02,633 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:02,633 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45 empty. 2023-02-18 15:01:02,633 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:02,634 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:02,634 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:02,634 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990 empty. 2023-02-18 15:01:02,634 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:02,634 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:02,635 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:02,635 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 15:01:02,663 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:02,666 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 39d83cfde4a830e40ab428208c2cedd3, NAME => 'testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp 2023-02-18 15:01:02,668 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7d643e504718c341f5d23797f65f832c, NAME => 'testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp 2023-02-18 15:01:02,668 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0a9e49a654a25d33ce2c87eb8d60e134, NAME => 'testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp 2023-02-18 15:01:02,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:02,819 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:02,820 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 39d83cfde4a830e40ab428208c2cedd3, disabling compactions & flushes 2023-02-18 15:01:02,820 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:02,820 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:02,820 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. after waiting 0 ms 2023-02-18 15:01:02,820 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:02,820 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:02,820 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 39d83cfde4a830e40ab428208c2cedd3: 2023-02-18 15:01:02,821 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 30da3b3610442bb6d6fe624fcec2de90, NAME => 'testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp 2023-02-18 15:01:02,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:02,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 7d643e504718c341f5d23797f65f832c, disabling compactions & flushes 2023-02-18 15:01:02,822 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:02,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:02,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. after waiting 0 ms 2023-02-18 15:01:02,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:02,822 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:02,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 7d643e504718c341f5d23797f65f832c: 2023-02-18 15:01:02,822 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => bc5da7d6cfb34e088b8cc688b083d74b, NAME => 'testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp 2023-02-18 15:01:02,854 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:02,855 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 30da3b3610442bb6d6fe624fcec2de90, disabling compactions & flushes 2023-02-18 15:01:02,855 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:02,855 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:02,855 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. after waiting 0 ms 2023-02-18 15:01:02,855 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:02,855 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:02,855 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 30da3b3610442bb6d6fe624fcec2de90: 2023-02-18 15:01:02,856 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e47b3c30328aecb262c445857eab5a45, NAME => 'testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp 2023-02-18 15:01:02,867 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:02,868 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing bc5da7d6cfb34e088b8cc688b083d74b, disabling compactions & flushes 2023-02-18 15:01:02,868 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:02,868 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:02,868 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. after waiting 0 ms 2023-02-18 15:01:02,868 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:02,868 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:02,868 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for bc5da7d6cfb34e088b8cc688b083d74b: 2023-02-18 15:01:02,869 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3f21eb7f443add362b469d2c02a35430, NAME => 'testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp 2023-02-18 15:01:02,882 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:02,883 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e47b3c30328aecb262c445857eab5a45, disabling compactions & flushes 2023-02-18 15:01:02,883 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:02,883 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:02,883 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. after waiting 0 ms 2023-02-18 15:01:02,883 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:02,883 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:02,883 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e47b3c30328aecb262c445857eab5a45: 2023-02-18 15:01:02,884 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 205bb2a0c3f98ef17e15352ea574c983, NAME => 'testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp 2023-02-18 15:01:02,900 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:02,902 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 3f21eb7f443add362b469d2c02a35430, disabling compactions & flushes 2023-02-18 15:01:02,902 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:02,902 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:02,902 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. after waiting 0 ms 2023-02-18 15:01:02,902 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:02,902 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:02,902 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 3f21eb7f443add362b469d2c02a35430: 2023-02-18 15:01:02,903 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6a6e1ad761fbe4daf556174450868f9a, NAME => 'testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp 2023-02-18 15:01:02,919 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:02,920 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 205bb2a0c3f98ef17e15352ea574c983, disabling compactions & flushes 2023-02-18 15:01:02,920 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:02,921 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:02,921 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. after waiting 0 ms 2023-02-18 15:01:02,921 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:02,921 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:02,921 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 205bb2a0c3f98ef17e15352ea574c983: 2023-02-18 15:01:02,921 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2e392bd4cb4c185ea77b956fdf9dd990, NAME => 'testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp 2023-02-18 15:01:02,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:03,219 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,219 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0a9e49a654a25d33ce2c87eb8d60e134, disabling compactions & flushes 2023-02-18 15:01:03,219 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:03,220 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:03,220 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. after waiting 0 ms 2023-02-18 15:01:03,220 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:03,220 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:03,220 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0a9e49a654a25d33ce2c87eb8d60e134: 2023-02-18 15:01:03,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:03,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 6a6e1ad761fbe4daf556174450868f9a, disabling compactions & flushes 2023-02-18 15:01:03,330 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:03,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:03,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. after waiting 0 ms 2023-02-18 15:01:03,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:03,330 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:03,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 6a6e1ad761fbe4daf556174450868f9a: 2023-02-18 15:01:03,344 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,344 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 2e392bd4cb4c185ea77b956fdf9dd990, disabling compactions & flushes 2023-02-18 15:01:03,344 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:03,344 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:03,344 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. after waiting 0 ms 2023-02-18 15:01:03,344 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:03,344 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:03,344 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 2e392bd4cb4c185ea77b956fdf9dd990: 2023-02-18 15:01:03,351 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:03,352 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732463352"}]},"ts":"1676732463352"} 2023-02-18 15:01:03,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732463352"}]},"ts":"1676732463352"} 2023-02-18 15:01:03,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732463352"}]},"ts":"1676732463352"} 2023-02-18 15:01:03,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732463352"}]},"ts":"1676732463352"} 2023-02-18 15:01:03,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732463352"}]},"ts":"1676732463352"} 2023-02-18 15:01:03,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732463352"}]},"ts":"1676732463352"} 2023-02-18 15:01:03,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732463352"}]},"ts":"1676732463352"} 2023-02-18 15:01:03,354 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732463352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732463352"}]},"ts":"1676732463352"} 2023-02-18 15:01:03,354 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732463352"}]},"ts":"1676732463352"} 2023-02-18 15:01:03,354 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732463352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732463352"}]},"ts":"1676732463352"} 2023-02-18 15:01:03,402 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-18 15:01:03,404 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:03,405 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732463404"}]},"ts":"1676732463404"} 2023-02-18 15:01:03,407 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-18 15:01:03,418 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:03,431 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:03,431 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:03,431 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:03,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0a9e49a654a25d33ce2c87eb8d60e134, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7d643e504718c341f5d23797f65f832c, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=39d83cfde4a830e40ab428208c2cedd3, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=30da3b3610442bb6d6fe624fcec2de90, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bc5da7d6cfb34e088b8cc688b083d74b, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e47b3c30328aecb262c445857eab5a45, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3f21eb7f443add362b469d2c02a35430, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=205bb2a0c3f98ef17e15352ea574c983, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6a6e1ad761fbe4daf556174450868f9a, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2e392bd4cb4c185ea77b956fdf9dd990, ASSIGN}] 2023-02-18 15:01:03,436 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7d643e504718c341f5d23797f65f832c, ASSIGN 2023-02-18 15:01:03,437 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=39d83cfde4a830e40ab428208c2cedd3, ASSIGN 2023-02-18 15:01:03,437 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0a9e49a654a25d33ce2c87eb8d60e134, ASSIGN 2023-02-18 15:01:03,438 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=30da3b3610442bb6d6fe624fcec2de90, ASSIGN 2023-02-18 15:01:03,439 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7d643e504718c341f5d23797f65f832c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46385,1676732459629; forceNewPlan=false, retain=false 2023-02-18 15:01:03,439 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0a9e49a654a25d33ce2c87eb8d60e134, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46385,1676732459629; forceNewPlan=false, retain=false 2023-02-18 15:01:03,439 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=39d83cfde4a830e40ab428208c2cedd3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46721,1676732459680; forceNewPlan=false, retain=false 2023-02-18 15:01:03,441 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2e392bd4cb4c185ea77b956fdf9dd990, ASSIGN 2023-02-18 15:01:03,441 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=30da3b3610442bb6d6fe624fcec2de90, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46721,1676732459680; forceNewPlan=false, retain=false 2023-02-18 15:01:03,441 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6a6e1ad761fbe4daf556174450868f9a, ASSIGN 2023-02-18 15:01:03,441 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=205bb2a0c3f98ef17e15352ea574c983, ASSIGN 2023-02-18 15:01:03,441 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3f21eb7f443add362b469d2c02a35430, ASSIGN 2023-02-18 15:01:03,442 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2e392bd4cb4c185ea77b956fdf9dd990, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46385,1676732459629; forceNewPlan=false, retain=false 2023-02-18 15:01:03,442 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6a6e1ad761fbe4daf556174450868f9a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46721,1676732459680; forceNewPlan=false, retain=false 2023-02-18 15:01:03,442 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=205bb2a0c3f98ef17e15352ea574c983, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46721,1676732459680; forceNewPlan=false, retain=false 2023-02-18 15:01:03,442 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e47b3c30328aecb262c445857eab5a45, ASSIGN 2023-02-18 15:01:03,443 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3f21eb7f443add362b469d2c02a35430, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46385,1676732459629; forceNewPlan=false, retain=false 2023-02-18 15:01:03,443 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bc5da7d6cfb34e088b8cc688b083d74b, ASSIGN 2023-02-18 15:01:03,444 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e47b3c30328aecb262c445857eab5a45, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46721,1676732459680; forceNewPlan=false, retain=false 2023-02-18 15:01:03,445 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bc5da7d6cfb34e088b8cc688b083d74b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46385,1676732459629; forceNewPlan=false, retain=false 2023-02-18 15:01:03,590 INFO [jenkins-hbase4:39419] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-18 15:01:03,594 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=39d83cfde4a830e40ab428208c2cedd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:03,594 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=30da3b3610442bb6d6fe624fcec2de90, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:03,594 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6a6e1ad761fbe4daf556174450868f9a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:03,594 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e47b3c30328aecb262c445857eab5a45, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:03,595 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732463594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732463594"}]},"ts":"1676732463594"} 2023-02-18 15:01:03,594 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=205bb2a0c3f98ef17e15352ea574c983, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:03,595 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732463594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732463594"}]},"ts":"1676732463594"} 2023-02-18 15:01:03,595 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732463594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732463594"}]},"ts":"1676732463594"} 2023-02-18 15:01:03,594 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732463594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732463594"}]},"ts":"1676732463594"} 2023-02-18 15:01:03,595 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732463594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732463594"}]},"ts":"1676732463594"} 2023-02-18 15:01:03,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 30da3b3610442bb6d6fe624fcec2de90, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:03,600 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure e47b3c30328aecb262c445857eab5a45, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:03,604 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2e392bd4cb4c185ea77b956fdf9dd990, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:03,604 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732463604"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732463604"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732463604"}]},"ts":"1676732463604"} 2023-02-18 15:01:03,606 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0a9e49a654a25d33ce2c87eb8d60e134, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:03,606 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732463605"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732463605"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732463605"}]},"ts":"1676732463605"} 2023-02-18 15:01:03,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=19, state=RUNNABLE; OpenRegionProcedure 6a6e1ad761fbe4daf556174450868f9a, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:03,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=13, state=RUNNABLE; OpenRegionProcedure 39d83cfde4a830e40ab428208c2cedd3, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:03,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=18, state=RUNNABLE; OpenRegionProcedure 205bb2a0c3f98ef17e15352ea574c983, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:03,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure 2e392bd4cb4c185ea77b956fdf9dd990, server=jenkins-hbase4.apache.org,46385,1676732459629}] 2023-02-18 15:01:03,616 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=7d643e504718c341f5d23797f65f832c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:03,617 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732463616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732463616"}]},"ts":"1676732463616"} 2023-02-18 15:01:03,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 0a9e49a654a25d33ce2c87eb8d60e134, server=jenkins-hbase4.apache.org,46385,1676732459629}] 2023-02-18 15:01:03,618 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=bc5da7d6cfb34e088b8cc688b083d74b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:03,618 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732463618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732463618"}]},"ts":"1676732463618"} 2023-02-18 15:01:03,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure 7d643e504718c341f5d23797f65f832c, server=jenkins-hbase4.apache.org,46385,1676732459629}] 2023-02-18 15:01:03,628 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3f21eb7f443add362b469d2c02a35430, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:03,628 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732463627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732463627"}]},"ts":"1676732463627"} 2023-02-18 15:01:03,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=15, state=RUNNABLE; OpenRegionProcedure bc5da7d6cfb34e088b8cc688b083d74b, server=jenkins-hbase4.apache.org,46385,1676732459629}] 2023-02-18 15:01:03,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=17, state=RUNNABLE; OpenRegionProcedure 3f21eb7f443add362b469d2c02a35430, server=jenkins-hbase4.apache.org,46385,1676732459629}] 2023-02-18 15:01:03,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:03,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e47b3c30328aecb262c445857eab5a45, NAME => 'testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-18 15:01:03,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:03,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:03,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:03,765 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:03,767 DEBUG [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1 2023-02-18 15:01:03,767 DEBUG [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1 2023-02-18 15:01:03,772 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:03,772 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:03,773 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e47b3c30328aecb262c445857eab5a45 columnFamilyName f1 2023-02-18 15:01:03,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:03,774 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] regionserver.HStore(310): Store=e47b3c30328aecb262c445857eab5a45/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,775 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:03,777 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40656, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:03,779 DEBUG [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2 2023-02-18 15:01:03,779 DEBUG [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2 2023-02-18 15:01:03,780 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e47b3c30328aecb262c445857eab5a45 columnFamilyName f2 2023-02-18 15:01:03,781 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] regionserver.HStore(310): Store=e47b3c30328aecb262c445857eab5a45/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:03,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:03,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bc5da7d6cfb34e088b8cc688b083d74b, NAME => 'testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-18 15:01:03,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:03,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:03,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:03,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:03,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:03,791 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:03,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:03,797 DEBUG [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1 2023-02-18 15:01:03,797 DEBUG [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1 2023-02-18 15:01:03,798 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc5da7d6cfb34e088b8cc688b083d74b columnFamilyName f1 2023-02-18 15:01:03,798 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] regionserver.HStore(310): Store=bc5da7d6cfb34e088b8cc688b083d74b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,799 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:03,801 DEBUG [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2 2023-02-18 15:01:03,801 DEBUG [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2 2023-02-18 15:01:03,801 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc5da7d6cfb34e088b8cc688b083d74b columnFamilyName f2 2023-02-18 15:01:03,802 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] regionserver.HStore(310): Store=bc5da7d6cfb34e088b8cc688b083d74b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:03,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:03,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:03,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e47b3c30328aecb262c445857eab5a45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73552787, jitterRate=0.09602193534374237}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:03,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e47b3c30328aecb262c445857eab5a45: 2023-02-18 15:01:03,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45., pid=22, masterSystemTime=1676732463752 2023-02-18 15:01:03,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:03,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:03,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:03,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:03,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 205bb2a0c3f98ef17e15352ea574c983, NAME => 'testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-18 15:01:03,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:03,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:03,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:03,813 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e47b3c30328aecb262c445857eab5a45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:03,813 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463812"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732463812"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732463812"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732463812"}]},"ts":"1676732463812"} 2023-02-18 15:01:03,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:03,816 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:03,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:03,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bc5da7d6cfb34e088b8cc688b083d74b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72207811, jitterRate=0.07598023116588593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:03,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bc5da7d6cfb34e088b8cc688b083d74b: 2023-02-18 15:01:03,824 DEBUG [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1 2023-02-18 15:01:03,824 DEBUG [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1 2023-02-18 15:01:03,824 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 205bb2a0c3f98ef17e15352ea574c983 columnFamilyName f1 2023-02-18 15:01:03,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b., pid=29, masterSystemTime=1676732463769 2023-02-18 15:01:03,826 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] regionserver.HStore(310): Store=205bb2a0c3f98ef17e15352ea574c983/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,827 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:03,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:03,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:03,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:03,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f21eb7f443add362b469d2c02a35430, NAME => 'testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-18 15:01:03,829 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-18 15:01:03,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure e47b3c30328aecb262c445857eab5a45, server=jenkins-hbase4.apache.org,46721,1676732459680 in 224 msec 2023-02-18 15:01:03,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:03,830 DEBUG [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2 2023-02-18 15:01:03,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,830 DEBUG [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2 2023-02-18 15:01:03,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:03,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:03,831 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 205bb2a0c3f98ef17e15352ea574c983 columnFamilyName f2 2023-02-18 15:01:03,831 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=bc5da7d6cfb34e088b8cc688b083d74b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:03,831 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463831"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732463831"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732463831"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732463831"}]},"ts":"1676732463831"} 2023-02-18 15:01:03,831 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] regionserver.HStore(310): Store=205bb2a0c3f98ef17e15352ea574c983/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,833 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:03,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e47b3c30328aecb262c445857eab5a45, ASSIGN in 398 msec 2023-02-18 15:01:03,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:03,835 DEBUG [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1 2023-02-18 15:01:03,835 DEBUG [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1 2023-02-18 15:01:03,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:03,836 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f21eb7f443add362b469d2c02a35430 columnFamilyName f1 2023-02-18 15:01:03,837 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] regionserver.HStore(310): Store=3f21eb7f443add362b469d2c02a35430/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,837 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:03,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=15 2023-02-18 15:01:03,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=15, state=SUCCESS; OpenRegionProcedure bc5da7d6cfb34e088b8cc688b083d74b, server=jenkins-hbase4.apache.org,46385,1676732459629 in 206 msec 2023-02-18 15:01:03,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:03,840 DEBUG [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2 2023-02-18 15:01:03,840 DEBUG [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2 2023-02-18 15:01:03,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bc5da7d6cfb34e088b8cc688b083d74b, ASSIGN in 407 msec 2023-02-18 15:01:03,842 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f21eb7f443add362b469d2c02a35430 columnFamilyName f2 2023-02-18 15:01:03,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:03,843 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] regionserver.HStore(310): Store=3f21eb7f443add362b469d2c02a35430/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:03,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:03,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:03,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 205bb2a0c3f98ef17e15352ea574c983; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64347869, jitterRate=-0.04114203155040741}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:03,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 205bb2a0c3f98ef17e15352ea574c983: 2023-02-18 15:01:03,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:03,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983., pid=25, masterSystemTime=1676732463752 2023-02-18 15:01:03,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:03,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:03,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:03,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:03,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 39d83cfde4a830e40ab428208c2cedd3, NAME => 'testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-18 15:01:03,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:03,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:03,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:03,861 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=205bb2a0c3f98ef17e15352ea574c983, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:03,862 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463861"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732463861"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732463861"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732463861"}]},"ts":"1676732463861"} 2023-02-18 15:01:03,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:03,863 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:03,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3f21eb7f443add362b469d2c02a35430; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62961341, jitterRate=-0.06180290877819061}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:03,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3f21eb7f443add362b469d2c02a35430: 2023-02-18 15:01:03,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430., pid=30, masterSystemTime=1676732463769 2023-02-18 15:01:03,866 DEBUG [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1 2023-02-18 15:01:03,867 DEBUG [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1 2023-02-18 15:01:03,867 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39d83cfde4a830e40ab428208c2cedd3 columnFamilyName f1 2023-02-18 15:01:03,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:03,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:03,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:03,868 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] regionserver.HStore(310): Store=39d83cfde4a830e40ab428208c2cedd3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2e392bd4cb4c185ea77b956fdf9dd990, NAME => 'testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-18 15:01:03,869 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:03,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:03,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:03,870 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3f21eb7f443add362b469d2c02a35430, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:03,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:03,870 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463869"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732463869"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732463869"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732463869"}]},"ts":"1676732463869"} 2023-02-18 15:01:03,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=18 2023-02-18 15:01:03,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=18, state=SUCCESS; OpenRegionProcedure 205bb2a0c3f98ef17e15352ea574c983, server=jenkins-hbase4.apache.org,46721,1676732459680 in 253 msec 2023-02-18 15:01:03,872 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:03,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=205bb2a0c3f98ef17e15352ea574c983, ASSIGN in 439 msec 2023-02-18 15:01:03,881 DEBUG [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/f1 2023-02-18 15:01:03,881 DEBUG [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/f1 2023-02-18 15:01:03,881 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e392bd4cb4c185ea77b956fdf9dd990 columnFamilyName f1 2023-02-18 15:01:03,882 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] regionserver.HStore(310): Store=2e392bd4cb4c185ea77b956fdf9dd990/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,882 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:03,883 DEBUG [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2 2023-02-18 15:01:03,884 DEBUG [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2 2023-02-18 15:01:03,884 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39d83cfde4a830e40ab428208c2cedd3 columnFamilyName f2 2023-02-18 15:01:03,885 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] regionserver.HStore(310): Store=39d83cfde4a830e40ab428208c2cedd3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,885 DEBUG [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/f2 2023-02-18 15:01:03,886 DEBUG [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/f2 2023-02-18 15:01:03,887 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e392bd4cb4c185ea77b956fdf9dd990 columnFamilyName f2 2023-02-18 15:01:03,888 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] regionserver.HStore(310): Store=2e392bd4cb4c185ea77b956fdf9dd990/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:03,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:03,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:03,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=17 2023-02-18 15:01:03,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=17, state=SUCCESS; OpenRegionProcedure 3f21eb7f443add362b469d2c02a35430, server=jenkins-hbase4.apache.org,46385,1676732459629 in 252 msec 2023-02-18 15:01:03,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:03,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:03,894 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3f21eb7f443add362b469d2c02a35430, ASSIGN in 460 msec 2023-02-18 15:01:03,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:03,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:03,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:03,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:03,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 39d83cfde4a830e40ab428208c2cedd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67348714, jitterRate=0.0035740435123443604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:03,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 39d83cfde4a830e40ab428208c2cedd3: 2023-02-18 15:01:03,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:03,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3., pid=24, masterSystemTime=1676732463752 2023-02-18 15:01:03,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2e392bd4cb4c185ea77b956fdf9dd990; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65485368, jitterRate=-0.024191975593566895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:03,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2e392bd4cb4c185ea77b956fdf9dd990: 2023-02-18 15:01:03,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990., pid=26, masterSystemTime=1676732463769 2023-02-18 15:01:03,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:03,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:03,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:03,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6a6e1ad761fbe4daf556174450868f9a, NAME => 'testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-18 15:01:03,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:03,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:03,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:03,912 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=39d83cfde4a830e40ab428208c2cedd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:03,912 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:03,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:03,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:03,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:03,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0a9e49a654a25d33ce2c87eb8d60e134, NAME => 'testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-18 15:01:03,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:03,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:03,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:03,912 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463912"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732463912"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732463912"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732463912"}]},"ts":"1676732463912"} 2023-02-18 15:01:03,914 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2e392bd4cb4c185ea77b956fdf9dd990, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:03,915 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732463914"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732463914"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732463914"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732463914"}]},"ts":"1676732463914"} 2023-02-18 15:01:03,916 DEBUG [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1 2023-02-18 15:01:03,918 DEBUG [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1 2023-02-18 15:01:03,918 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:03,919 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a6e1ad761fbe4daf556174450868f9a columnFamilyName f1 2023-02-18 15:01:03,920 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] regionserver.HStore(310): Store=6a6e1ad761fbe4daf556174450868f9a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,920 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:03,921 DEBUG [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/f1 2023-02-18 15:01:03,921 DEBUG [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/f1 2023-02-18 15:01:03,922 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a9e49a654a25d33ce2c87eb8d60e134 columnFamilyName f1 2023-02-18 15:01:03,923 DEBUG [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2 2023-02-18 15:01:03,923 DEBUG [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2 2023-02-18 15:01:03,923 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] regionserver.HStore(310): Store=0a9e49a654a25d33ce2c87eb8d60e134/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=13 2023-02-18 15:01:03,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=13, state=SUCCESS; OpenRegionProcedure 39d83cfde4a830e40ab428208c2cedd3, server=jenkins-hbase4.apache.org,46721,1676732459680 in 309 msec 2023-02-18 15:01:03,923 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:03,924 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a6e1ad761fbe4daf556174450868f9a columnFamilyName f2 2023-02-18 15:01:03,925 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] regionserver.HStore(310): Store=6a6e1ad761fbe4daf556174450868f9a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-18 15:01:03,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure 2e392bd4cb4c185ea77b956fdf9dd990, server=jenkins-hbase4.apache.org,46385,1676732459629 in 306 msec 2023-02-18 15:01:03,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:03,927 DEBUG [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/f2 2023-02-18 15:01:03,927 DEBUG [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/f2 2023-02-18 15:01:03,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:03,928 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a9e49a654a25d33ce2c87eb8d60e134 columnFamilyName f2 2023-02-18 15:01:03,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=39d83cfde4a830e40ab428208c2cedd3, ASSIGN in 492 msec 2023-02-18 15:01:03,930 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] regionserver.HStore(310): Store=0a9e49a654a25d33ce2c87eb8d60e134/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2e392bd4cb4c185ea77b956fdf9dd990, ASSIGN in 495 msec 2023-02-18 15:01:03,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:03,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:03,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:03,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:03,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:03,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:03,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6a6e1ad761fbe4daf556174450868f9a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59629095, jitterRate=-0.11145724356174469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:03,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:03,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6a6e1ad761fbe4daf556174450868f9a: 2023-02-18 15:01:03,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a., pid=23, masterSystemTime=1676732463752 2023-02-18 15:01:03,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:03,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:03,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0a9e49a654a25d33ce2c87eb8d60e134; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65114068, jitterRate=-0.02972477674484253}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:03,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:03,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:03,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 30da3b3610442bb6d6fe624fcec2de90, NAME => 'testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-18 15:01:03,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:03,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:03,943 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6a6e1ad761fbe4daf556174450868f9a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:03,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0a9e49a654a25d33ce2c87eb8d60e134: 2023-02-18 15:01:03,943 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463943"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732463943"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732463943"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732463943"}]},"ts":"1676732463943"} 2023-02-18 15:01:03,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:03,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134., pid=27, masterSystemTime=1676732463769 2023-02-18 15:01:03,946 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:03,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:03,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:03,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:03,948 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0a9e49a654a25d33ce2c87eb8d60e134, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:03,948 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732463947"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732463947"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732463947"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732463947"}]},"ts":"1676732463947"} 2023-02-18 15:01:03,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7d643e504718c341f5d23797f65f832c, NAME => 'testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-18 15:01:03,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:03,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:03,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:03,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:03,949 DEBUG [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1 2023-02-18 15:01:03,949 DEBUG [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1 2023-02-18 15:01:03,950 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30da3b3610442bb6d6fe624fcec2de90 columnFamilyName f1 2023-02-18 15:01:03,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=19 2023-02-18 15:01:03,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=19, state=SUCCESS; OpenRegionProcedure 6a6e1ad761fbe4daf556174450868f9a, server=jenkins-hbase4.apache.org,46721,1676732459680 in 337 msec 2023-02-18 15:01:03,951 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] regionserver.HStore(310): Store=30da3b3610442bb6d6fe624fcec2de90/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,951 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:03,953 DEBUG [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2 2023-02-18 15:01:03,953 DEBUG [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2 2023-02-18 15:01:03,954 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30da3b3610442bb6d6fe624fcec2de90 columnFamilyName f2 2023-02-18 15:01:03,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6a6e1ad761fbe4daf556174450868f9a, ASSIGN in 518 msec 2023-02-18 15:01:03,955 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] regionserver.HStore(310): Store=30da3b3610442bb6d6fe624fcec2de90/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,957 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:03,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:03,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-18 15:01:03,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 0a9e49a654a25d33ce2c87eb8d60e134, server=jenkins-hbase4.apache.org,46385,1676732459629 in 336 msec 2023-02-18 15:01:03,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:03,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0a9e49a654a25d33ce2c87eb8d60e134, ASSIGN in 526 msec 2023-02-18 15:01:03,961 DEBUG [StoreOpener-7d643e504718c341f5d23797f65f832c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1 2023-02-18 15:01:03,961 DEBUG [StoreOpener-7d643e504718c341f5d23797f65f832c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1 2023-02-18 15:01:03,961 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d643e504718c341f5d23797f65f832c columnFamilyName f1 2023-02-18 15:01:03,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:03,965 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] regionserver.HStore(310): Store=7d643e504718c341f5d23797f65f832c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,965 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:03,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:03,968 DEBUG [StoreOpener-7d643e504718c341f5d23797f65f832c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2 2023-02-18 15:01:03,968 DEBUG [StoreOpener-7d643e504718c341f5d23797f65f832c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2 2023-02-18 15:01:03,969 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d643e504718c341f5d23797f65f832c columnFamilyName f2 2023-02-18 15:01:03,969 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] regionserver.HStore(310): Store=7d643e504718c341f5d23797f65f832c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:03,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:03,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:03,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:03,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 30da3b3610442bb6d6fe624fcec2de90; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58982879, jitterRate=-0.12108661234378815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:03,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 30da3b3610442bb6d6fe624fcec2de90: 2023-02-18 15:01:03,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90., pid=21, masterSystemTime=1676732463752 2023-02-18 15:01:03,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:03,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:03,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:03,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:03,977 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=30da3b3610442bb6d6fe624fcec2de90, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:03,977 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463977"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732463977"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732463977"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732463977"}]},"ts":"1676732463977"} 2023-02-18 15:01:03,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:03,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7d643e504718c341f5d23797f65f832c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63218489, jitterRate=-0.057971104979515076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:03,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7d643e504718c341f5d23797f65f832c: 2023-02-18 15:01:03,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c., pid=28, masterSystemTime=1676732463769 2023-02-18 15:01:03,983 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-18 15:01:03,983 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 30da3b3610442bb6d6fe624fcec2de90, server=jenkins-hbase4.apache.org,46721,1676732459680 in 382 msec 2023-02-18 15:01:03,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:03,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:03,986 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=7d643e504718c341f5d23797f65f832c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:03,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=30da3b3610442bb6d6fe624fcec2de90, ASSIGN in 551 msec 2023-02-18 15:01:03,986 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732463986"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732463986"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732463986"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732463986"}]},"ts":"1676732463986"} 2023-02-18 15:01:03,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-18 15:01:03,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure 7d643e504718c341f5d23797f65f832c, server=jenkins-hbase4.apache.org,46385,1676732459629 in 368 msec 2023-02-18 15:01:03,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-02-18 15:01:03,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7d643e504718c341f5d23797f65f832c, ASSIGN in 559 msec 2023-02-18 15:01:03,996 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:03,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732463996"}]},"ts":"1676732463996"} 2023-02-18 15:01:03,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-18 15:01:04,001 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:04,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.4060 sec 2023-02-18 15:01:04,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:04,778 INFO [Listener at localhost/42771] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-18 15:01:04,778 DEBUG [Listener at localhost/42771] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-18 15:01:04,780 INFO [Listener at localhost/42771] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:04,790 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-18 15:01:04,791 INFO [Listener at localhost/42771] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:04,791 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-18 15:01:04,791 INFO [Listener at localhost/42771] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 15:01:04,935 DEBUG [hconnection-0x4a1aa3d8-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:04,967 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40668, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:04,990 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46385] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:05,007 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46721] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:05,287 INFO [Listener at localhost/42771] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 15:01:05,291 INFO [Listener at localhost/42771] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 15:01:05,306 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 15:01:05,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676732465306 (current time:1676732465306). 2023-02-18 15:01:05,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 15:01:05,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] zookeeper.ReadOnlyZKClient(139): Connect 0x33c48b74 to 127.0.0.1:63142 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:05,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33d54c41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:05,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:05,328 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40470, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:05,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33c48b74 to 127.0.0.1:63142 2023-02-18 15:01:05,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:05,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 15:01:05,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 15:01:05,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 15:01:05,364 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 15:01:05,366 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676733065366 2023-02-18 15:01:05,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 15:01:05,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-18 15:01:05,371 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 15:01:05,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 15:01:05,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 24 msec 2023-02-18 15:01:05,374 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 15:01:05,374 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:05,375 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 15:01:05,375 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676733065375 2023-02-18 15:01:05,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-18 15:01:05,408 INFO [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-18 15:01:05,408 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:05,409 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-18 15:01:05,409 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-18 15:01:05,410 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:05,410 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 15:01:05,412 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:05,412 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:05,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:05,412 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:05,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 15:01:05,413 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:05,413 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:05,415 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,415 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:05,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-18 15:01:05,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 15:01:05,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 15:01:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 15:01:05,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:05,420 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-18 15:01:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-18 15:01:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 15:01:05,420 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 15:01:05,424 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-18 15:01:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-18 15:01:05,424 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:05,425 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 15:01:05,425 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-18 15:01:05,425 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-18 15:01:05,425 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:05,425 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46385,1676732459629' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-18 15:01:05,427 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 15:01:05,427 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-18 15:01:05,427 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46721,1676732459680' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-18 15:01:05,430 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:05,430 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:05,430 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:05,430 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:05,430 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:05,431 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:05,431 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:05,431 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 15:01:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:05,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46385,1676732459629' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-18 15:01:05,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ac30b14[Count = 1] remaining members to acquire global barrier 2023-02-18 15:01:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:05,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 15:01:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:05,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46721,1676732459680' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-18 15:01:05,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ac30b14[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:05,439 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-18 15:01:05,440 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:05,443 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:05,443 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:05,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:05,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:05,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:05,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:05,443 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 15:01:05,444 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 15:01:05,446 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,447 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:05,447 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:05,448 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:05,448 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. started... 2023-02-18 15:01:05,452 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 205bb2a0c3f98ef17e15352ea574c983 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:05,452 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:05,452 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. started... 2023-02-18 15:01:05,453 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:05,453 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. started... 2023-02-18 15:01:05,456 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 15:01:05,456 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:05,460 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bc5da7d6cfb34e088b8cc688b083d74b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:05,460 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 39d83cfde4a830e40ab428208c2cedd3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:05,460 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:05,456 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 15:01:05,461 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 15:01:05,461 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 15:01:05,460 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. started... 2023-02-18 15:01:05,460 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. started... 2023-02-18 15:01:05,461 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:05,461 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7d643e504718c341f5d23797f65f832c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 15:01:05,462 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. started... 2023-02-18 15:01:05,464 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 3f21eb7f443add362b469d2c02a35430 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:05,464 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e47b3c30328aecb262c445857eab5a45 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:05,475 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:05,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:05,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:05,482 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 15:01:05,659 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/.tmp/f1/2f81b6d0afae432fa62e9aae7006af12 2023-02-18 15:01:05,678 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/.tmp/f1/0d0c35ca19cd498191e2ab71693a450f 2023-02-18 15:01:05,681 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/.tmp/f1/e183eaf4ccb04554a9987e6895d8e412 2023-02-18 15:01:05,683 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:05,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:05,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:05,685 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-18 15:01:05,768 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/.tmp/f2/e84274a674234784a17c7fe62cdaf813 2023-02-18 15:01:05,773 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/.tmp/f2/b79cac028cb748f5a77aa60c010e435c 2023-02-18 15:01:05,775 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/.tmp/f2/a6c561242dde499db123c5339bbaf54a 2023-02-18 15:01:05,786 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/.tmp/f1/e183eaf4ccb04554a9987e6895d8e412 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1/e183eaf4ccb04554a9987e6895d8e412 2023-02-18 15:01:05,787 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/.tmp/f1/0d0c35ca19cd498191e2ab71693a450f as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1/0d0c35ca19cd498191e2ab71693a450f 2023-02-18 15:01:05,787 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/.tmp/f1/2f81b6d0afae432fa62e9aae7006af12 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1/2f81b6d0afae432fa62e9aae7006af12 2023-02-18 15:01:05,798 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1/e183eaf4ccb04554a9987e6895d8e412, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:05,799 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1/2f81b6d0afae432fa62e9aae7006af12, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:05,802 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/.tmp/f2/b79cac028cb748f5a77aa60c010e435c as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2/b79cac028cb748f5a77aa60c010e435c 2023-02-18 15:01:05,802 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/.tmp/f2/a6c561242dde499db123c5339bbaf54a as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2/a6c561242dde499db123c5339bbaf54a 2023-02-18 15:01:05,809 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1/0d0c35ca19cd498191e2ab71693a450f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:05,810 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/.tmp/f2/e84274a674234784a17c7fe62cdaf813 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2/e84274a674234784a17c7fe62cdaf813 2023-02-18 15:01:05,811 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2/b79cac028cb748f5a77aa60c010e435c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:05,813 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bc5da7d6cfb34e088b8cc688b083d74b in 353ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:05,813 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2/a6c561242dde499db123c5339bbaf54a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:05,815 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-18 15:01:05,816 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 7d643e504718c341f5d23797f65f832c in 354ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:05,816 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-18 15:01:05,820 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7d643e504718c341f5d23797f65f832c: 2023-02-18 15:01:05,820 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bc5da7d6cfb34e088b8cc688b083d74b: 2023-02-18 15:01:05,821 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2/e84274a674234784a17c7fe62cdaf813, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:05,821 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:05,821 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:05,822 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3f21eb7f443add362b469d2c02a35430 in 358ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:05,822 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3f21eb7f443add362b469d2c02a35430: 2023-02-18 15:01:05,822 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:05,828 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:05,828 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:05,828 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:05,832 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1/0d0c35ca19cd498191e2ab71693a450f] hfiles 2023-02-18 15:01:05,832 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1/2f81b6d0afae432fa62e9aae7006af12] hfiles 2023-02-18 15:01:05,832 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1/e183eaf4ccb04554a9987e6895d8e412] hfiles 2023-02-18 15:01:05,832 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1/2f81b6d0afae432fa62e9aae7006af12 for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:05,832 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1/0d0c35ca19cd498191e2ab71693a450f for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:05,832 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1/e183eaf4ccb04554a9987e6895d8e412 for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:05,837 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2/b79cac028cb748f5a77aa60c010e435c] hfiles 2023-02-18 15:01:05,837 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2/a6c561242dde499db123c5339bbaf54a] hfiles 2023-02-18 15:01:05,837 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2/e84274a674234784a17c7fe62cdaf813] hfiles 2023-02-18 15:01:05,837 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2/a6c561242dde499db123c5339bbaf54a for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:05,837 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2/b79cac028cb748f5a77aa60c010e435c for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:05,837 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2/e84274a674234784a17c7fe62cdaf813 for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:05,863 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. completed. 2023-02-18 15:01:05,863 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:05,863 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. completed. 2023-02-18 15:01:05,863 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:05,864 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:05,864 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 15:01:05,864 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. completed. 2023-02-18 15:01:05,864 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 15:01:05,864 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. started... 2023-02-18 15:01:05,864 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:05,864 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:05,864 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. started... 2023-02-18 15:01:05,865 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 15:01:05,865 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2e392bd4cb4c185ea77b956fdf9dd990: 2023-02-18 15:01:05,865 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0a9e49a654a25d33ce2c87eb8d60e134: 2023-02-18 15:01:05,865 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:05,865 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:05,865 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:05,865 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:05,866 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:05,866 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:05,866 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:05,866 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:05,877 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. completed. 2023-02-18 15:01:05,878 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. completed. 2023-02-18 15:01:05,878 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:05,878 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:05,878 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 15:01:05,878 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 15:01:05,878 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 15:01:05,878 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,878 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-18 15:01:05,878 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,46385,1676732459629' in zk 2023-02-18 15:01:05,881 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,881 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-18 15:01:05,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:05,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:05,881 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:05,881 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-18 15:01:05,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:05,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:05,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 15:01:05,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:05,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:05,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 15:01:05,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:05,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,46385,1676732459629': 2023-02-18 15:01:05,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46385,1676732459629' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 15:01:05,985 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:05,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:05,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:05,987 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-18 15:01:06,078 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/.tmp/f1/458a6a88c51741e0abb692dad3965479 2023-02-18 15:01:06,078 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/.tmp/f1/94632aa0690e4107aa37e0385115b5a2 2023-02-18 15:01:06,080 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/.tmp/f1/b009c55e1b0944ea86cec96a47534d2f 2023-02-18 15:01:06,137 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/.tmp/f2/07d133cb500949f6b803955ff9730fff 2023-02-18 15:01:06,141 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/.tmp/f2/8ded650abc0b4f84877abe83dd95663d 2023-02-18 15:01:06,148 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/.tmp/f1/b009c55e1b0944ea86cec96a47534d2f as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1/b009c55e1b0944ea86cec96a47534d2f 2023-02-18 15:01:06,151 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/.tmp/f1/458a6a88c51741e0abb692dad3965479 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1/458a6a88c51741e0abb692dad3965479 2023-02-18 15:01:06,157 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1/b009c55e1b0944ea86cec96a47534d2f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:06,159 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/.tmp/f2/07d133cb500949f6b803955ff9730fff as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2/07d133cb500949f6b803955ff9730fff 2023-02-18 15:01:06,159 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1/458a6a88c51741e0abb692dad3965479, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:06,160 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/.tmp/f2/8ded650abc0b4f84877abe83dd95663d as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2/8ded650abc0b4f84877abe83dd95663d 2023-02-18 15:01:06,166 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2/07d133cb500949f6b803955ff9730fff, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:06,168 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 39d83cfde4a830e40ab428208c2cedd3 in 707ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:06,168 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 39d83cfde4a830e40ab428208c2cedd3: 2023-02-18 15:01:06,168 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,168 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:06,168 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1/b009c55e1b0944ea86cec96a47534d2f] hfiles 2023-02-18 15:01:06,168 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1/b009c55e1b0944ea86cec96a47534d2f for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,168 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2/07d133cb500949f6b803955ff9730fff] hfiles 2023-02-18 15:01:06,168 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2/07d133cb500949f6b803955ff9730fff for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,168 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2/8ded650abc0b4f84877abe83dd95663d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:06,170 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e47b3c30328aecb262c445857eab5a45 in 706ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:06,170 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e47b3c30328aecb262c445857eab5a45: 2023-02-18 15:01:06,171 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,171 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:06,171 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1/458a6a88c51741e0abb692dad3965479] hfiles 2023-02-18 15:01:06,171 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1/458a6a88c51741e0abb692dad3965479 for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,171 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2/8ded650abc0b4f84877abe83dd95663d] hfiles 2023-02-18 15:01:06,171 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2/8ded650abc0b4f84877abe83dd95663d for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,186 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. completed. 2023-02-18 15:01:06,186 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:06,186 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:06,186 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 15:01:06,186 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. started... 2023-02-18 15:01:06,187 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 6a6e1ad761fbe4daf556174450868f9a 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 15:01:06,205 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/.tmp/f1/938dbe1dee8c4c20847fe98b5c0260a3 2023-02-18 15:01:06,228 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/.tmp/f2/1f581c3952b54bae9cba0185c1acb596 2023-02-18 15:01:06,236 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/.tmp/f1/938dbe1dee8c4c20847fe98b5c0260a3 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1/938dbe1dee8c4c20847fe98b5c0260a3 2023-02-18 15:01:06,243 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1/938dbe1dee8c4c20847fe98b5c0260a3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:06,244 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/.tmp/f2/1f581c3952b54bae9cba0185c1acb596 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2/1f581c3952b54bae9cba0185c1acb596 2023-02-18 15:01:06,250 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2/1f581c3952b54bae9cba0185c1acb596, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:06,252 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 6a6e1ad761fbe4daf556174450868f9a in 65ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:06,252 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6a6e1ad761fbe4daf556174450868f9a: 2023-02-18 15:01:06,252 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,252 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:06,252 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1/938dbe1dee8c4c20847fe98b5c0260a3] hfiles 2023-02-18 15:01:06,252 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1/938dbe1dee8c4c20847fe98b5c0260a3 for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,252 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2/1f581c3952b54bae9cba0185c1acb596] hfiles 2023-02-18 15:01:06,252 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2/1f581c3952b54bae9cba0185c1acb596 for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,262 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. completed. 2023-02-18 15:01:06,263 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:06,263 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:06,263 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 15:01:06,263 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. started... 2023-02-18 15:01:06,264 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 30da3b3610442bb6d6fe624fcec2de90 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:06,276 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/.tmp/f1/78c4b72b4fe64762a4e6edeb9b0bd05e 2023-02-18 15:01:06,295 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/.tmp/f2/1c85c3f1479643aeaa0048d27054bc27 2023-02-18 15:01:06,303 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/.tmp/f1/78c4b72b4fe64762a4e6edeb9b0bd05e as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1/78c4b72b4fe64762a4e6edeb9b0bd05e 2023-02-18 15:01:06,310 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1/78c4b72b4fe64762a4e6edeb9b0bd05e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:06,311 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/.tmp/f2/1c85c3f1479643aeaa0048d27054bc27 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2/1c85c3f1479643aeaa0048d27054bc27 2023-02-18 15:01:06,319 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2/1c85c3f1479643aeaa0048d27054bc27, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:06,320 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 30da3b3610442bb6d6fe624fcec2de90 in 56ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:06,320 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 30da3b3610442bb6d6fe624fcec2de90: 2023-02-18 15:01:06,320 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,320 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:06,320 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1/78c4b72b4fe64762a4e6edeb9b0bd05e] hfiles 2023-02-18 15:01:06,320 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1/78c4b72b4fe64762a4e6edeb9b0bd05e for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,320 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2/1c85c3f1479643aeaa0048d27054bc27] hfiles 2023-02-18 15:01:06,320 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2/1c85c3f1479643aeaa0048d27054bc27 for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,328 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. completed. 2023-02-18 15:01:06,328 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:06,328 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 15:01:06,487 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:06,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:06,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:06,496 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-18 15:01:06,529 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/.tmp/f2/3811bb0615034bef8bc4d720562c44c5 2023-02-18 15:01:06,539 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/.tmp/f1/94632aa0690e4107aa37e0385115b5a2 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1/94632aa0690e4107aa37e0385115b5a2 2023-02-18 15:01:06,546 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1/94632aa0690e4107aa37e0385115b5a2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:06,547 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/.tmp/f2/3811bb0615034bef8bc4d720562c44c5 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2/3811bb0615034bef8bc4d720562c44c5 2023-02-18 15:01:06,554 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2/3811bb0615034bef8bc4d720562c44c5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:06,555 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 205bb2a0c3f98ef17e15352ea574c983 in 1103ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:06,555 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 205bb2a0c3f98ef17e15352ea574c983: 2023-02-18 15:01:06,555 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,555 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:06,555 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1/94632aa0690e4107aa37e0385115b5a2] hfiles 2023-02-18 15:01:06,555 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1/94632aa0690e4107aa37e0385115b5a2 for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,555 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2/3811bb0615034bef8bc4d720562c44c5] hfiles 2023-02-18 15:01:06,556 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2/3811bb0615034bef8bc4d720562c44c5 for snapshot=testWithMapReduceMultiRegion 2023-02-18 15:01:06,570 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. completed. 2023-02-18 15:01:06,570 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:06,570 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 15:01:06,586 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. completed. 2023-02-18 15:01:06,586 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:06,586 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 15:01:06,586 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 15:01:06,586 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:06,586 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-18 15:01:06,587 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,46721,1676732459680' in zk 2023-02-18 15:01:06,589 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:06,589 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-18 15:01:06,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:06,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:06,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:06,589 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:06,590 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-18 15:01:06,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:06,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:06,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 15:01:06,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:06,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:06,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:06,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 15:01:06,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:06,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:06,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,46721,1676732459680': 2023-02-18 15:01:06,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46721,1676732459680' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 15:01:06,596 INFO [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-18 15:01:06,596 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:06,596 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:06,596 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-18 15:01:06,596 INFO [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 15:01:06,599 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:06,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:06,599 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:06,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:06,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:06,599 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:06,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:06,599 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:06,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:06,599 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:06,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:06,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:06,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:06,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:06,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:06,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:06,600 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:06,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:06,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:06,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:06,601 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:06,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 15:01:06,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:06,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 15:01:06,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:06,603 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:06,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:06,603 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:06,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:06,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 15:01:06,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:06,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:06,620 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:06,620 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:06,620 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:06,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:06,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:06,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:06,621 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:06,621 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:06,621 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:06,621 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-18 15:01:06,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-18 15:01:06,621 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 15:01:06,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:06,622 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:06,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:06,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:06,622 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 15:01:06,622 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:06,622 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:06,622 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:06,622 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 15:01:06,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:06,623 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 15:01:06,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:06,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-18 15:01:06,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-18 15:01:06,730 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-18 15:01:06,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-18 15:01:06,731 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-18 15:01:06,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676732465370Consolidate snapshot: testWithMapReduceMultiRegion at 1676732466622 (+1252 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676732466622Writing data manifest for testWithMapReduceMultiRegion at 1676732466654 (+32 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676732466678 (+24 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676732466730 (+52 ms) 2023-02-18 15:01:06,732 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 15:01:06,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.3600 sec 2023-02-18 15:01:06,997 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-18 15:01:07,062 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-18 15:01:07,062 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-18 15:01:07,496 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:07,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:07,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 15:01:07,498 INFO [Listener at localhost/42771] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 15:01:07,509 INFO [Listener at localhost/42771] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 15:01:07,522 INFO [Listener at localhost/42771] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 15:01:07,608 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46385] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:07,621 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46721] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:07,803 INFO [Listener at localhost/42771] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 15:01:07,819 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 15:01:07,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-18 15:01:07,825 INFO [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-18 15:01:07,826 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:07,826 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-18 15:01:07,826 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-18 15:01:07,827 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:07,827 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:07,829 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:07,829 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:07,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:07,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:07,829 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:07,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:07,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:07,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:07,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:07,830 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:07,830 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:07,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:07,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:07,831 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:07,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:07,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:07,831 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:07,831 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 15:01:07,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:07,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:07,832 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 15:01:07,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 15:01:07,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 15:01:07,833 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 15:01:07,833 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:07,833 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 15:01:07,834 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:07,834 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 15:01:07,834 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 15:01:07,835 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:07,835 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. started... 2023-02-18 15:01:07,836 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bc5da7d6cfb34e088b8cc688b083d74b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:07,836 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:07,836 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. started... 2023-02-18 15:01:07,836 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 205bb2a0c3f98ef17e15352ea574c983 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:07,837 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:07,837 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. started... 2023-02-18 15:01:07,837 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:07,837 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. started... 2023-02-18 15:01:07,838 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 7d643e504718c341f5d23797f65f832c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 15:01:07,838 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 15:01:07,838 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3f21eb7f443add362b469d2c02a35430 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:07,838 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 15:01:07,838 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:07,838 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. started... 2023-02-18 15:01:07,838 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 39d83cfde4a830e40ab428208c2cedd3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:07,839 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 15:01:07,843 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:07,843 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 15:01:07,843 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. started... 2023-02-18 15:01:07,845 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e47b3c30328aecb262c445857eab5a45 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:07,896 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/.tmp/f1/bb89cfa569e34c3e85270f87cd918908 2023-02-18 15:01:07,923 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/.tmp/f1/17fcee6b13f945b0b80cb0804f8a0211 2023-02-18 15:01:07,940 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/.tmp/f1/4941d03134b342988f2d4c106939d59b 2023-02-18 15:01:07,944 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/.tmp/f1/9c4bfeb3101e4033b94c1343c138a5c2 2023-02-18 15:01:07,945 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/.tmp/f1/61bf64811eb240b6a01429c4acd5d083 2023-02-18 15:01:07,945 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/.tmp/f2/aef2d691a5944ae7bdeeb5133e28e896 2023-02-18 15:01:08,004 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/.tmp/f1/bb89cfa569e34c3e85270f87cd918908 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1/bb89cfa569e34c3e85270f87cd918908 2023-02-18 15:01:08,012 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/.tmp/f2/e876d671995b45f890207094b418f0fa 2023-02-18 15:01:08,017 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1/bb89cfa569e34c3e85270f87cd918908, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,019 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/.tmp/f2/aef2d691a5944ae7bdeeb5133e28e896 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2/aef2d691a5944ae7bdeeb5133e28e896 2023-02-18 15:01:08,019 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/.tmp/f1/17fcee6b13f945b0b80cb0804f8a0211 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1/17fcee6b13f945b0b80cb0804f8a0211 2023-02-18 15:01:08,025 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2/aef2d691a5944ae7bdeeb5133e28e896, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,026 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1/17fcee6b13f945b0b80cb0804f8a0211, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,027 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3f21eb7f443add362b469d2c02a35430 in 188ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:08,027 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3f21eb7f443add362b469d2c02a35430: 2023-02-18 15:01:08,027 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:08,027 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/.tmp/f2/e876d671995b45f890207094b418f0fa as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2/e876d671995b45f890207094b418f0fa 2023-02-18 15:01:08,031 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:08,031 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 15:01:08,031 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. started... 2023-02-18 15:01:08,032 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2e392bd4cb4c185ea77b956fdf9dd990: 2023-02-18 15:01:08,032 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:08,032 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:08,032 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. started... 2023-02-18 15:01:08,032 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 15:01:08,032 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0a9e49a654a25d33ce2c87eb8d60e134: 2023-02-18 15:01:08,032 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:08,032 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 15:01:08,033 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2/e876d671995b45f890207094b418f0fa, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,034 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e47b3c30328aecb262c445857eab5a45 in 190ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:08,034 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e47b3c30328aecb262c445857eab5a45: 2023-02-18 15:01:08,034 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:08,034 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:08,034 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. started... 2023-02-18 15:01:08,034 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6a6e1ad761fbe4daf556174450868f9a 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 15:01:08,035 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 15:01:08,035 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/.tmp/f2/bd74383fa1224f00a2615600fb43e1f1 2023-02-18 15:01:08,037 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/.tmp/f2/7b35c94284c045d2aad68f8a3e3461f9 2023-02-18 15:01:08,041 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/.tmp/f2/b1351bb77d3342ec8517114e07e66beb 2023-02-18 15:01:08,047 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/.tmp/f1/4941d03134b342988f2d4c106939d59b as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1/4941d03134b342988f2d4c106939d59b 2023-02-18 15:01:08,048 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/.tmp/f1/61bf64811eb240b6a01429c4acd5d083 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1/61bf64811eb240b6a01429c4acd5d083 2023-02-18 15:01:08,049 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/.tmp/f1/9c4bfeb3101e4033b94c1343c138a5c2 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1/9c4bfeb3101e4033b94c1343c138a5c2 2023-02-18 15:01:08,054 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1/4941d03134b342988f2d4c106939d59b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,055 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1/61bf64811eb240b6a01429c4acd5d083, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:08,055 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/.tmp/f2/bd74383fa1224f00a2615600fb43e1f1 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2/bd74383fa1224f00a2615600fb43e1f1 2023-02-18 15:01:08,056 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1/9c4bfeb3101e4033b94c1343c138a5c2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,056 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/.tmp/f2/7b35c94284c045d2aad68f8a3e3461f9 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2/7b35c94284c045d2aad68f8a3e3461f9 2023-02-18 15:01:08,059 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/.tmp/f2/b1351bb77d3342ec8517114e07e66beb as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2/b1351bb77d3342ec8517114e07e66beb 2023-02-18 15:01:08,062 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2/7b35c94284c045d2aad68f8a3e3461f9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:08,063 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 7d643e504718c341f5d23797f65f832c in 226ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:08,063 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7d643e504718c341f5d23797f65f832c: 2023-02-18 15:01:08,064 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:08,064 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 15:01:08,066 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2/b1351bb77d3342ec8517114e07e66beb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,067 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 39d83cfde4a830e40ab428208c2cedd3 in 229ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:08,067 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 39d83cfde4a830e40ab428208c2cedd3: 2023-02-18 15:01:08,068 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:08,068 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:08,068 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 15:01:08,068 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. started... 2023-02-18 15:01:08,068 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 30da3b3610442bb6d6fe624fcec2de90 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:08,077 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2/bd74383fa1224f00a2615600fb43e1f1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,078 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/.tmp/f1/9e9c171d09ab44fbac4dd218b4ec9e62 2023-02-18 15:01:08,079 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 205bb2a0c3f98ef17e15352ea574c983 in 242ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:08,079 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 205bb2a0c3f98ef17e15352ea574c983: 2023-02-18 15:01:08,079 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:08,079 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 15:01:08,095 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/.tmp/f1/99f4454770fa45a795185ec47ffcf98a 2023-02-18 15:01:08,104 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/.tmp/f2/9edc38d46d85499bb491b427eb8877b0 2023-02-18 15:01:08,112 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/.tmp/f1/9e9c171d09ab44fbac4dd218b4ec9e62 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1/9e9c171d09ab44fbac4dd218b4ec9e62 2023-02-18 15:01:08,119 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1/9e9c171d09ab44fbac4dd218b4ec9e62, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:08,120 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/.tmp/f2/9edc38d46d85499bb491b427eb8877b0 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2/9edc38d46d85499bb491b427eb8877b0 2023-02-18 15:01:08,124 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/.tmp/f2/447feae449bb41af89ec325f7179dd66 2023-02-18 15:01:08,127 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2/9edc38d46d85499bb491b427eb8877b0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:08,128 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 6a6e1ad761fbe4daf556174450868f9a in 94ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:08,129 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6a6e1ad761fbe4daf556174450868f9a: 2023-02-18 15:01:08,129 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:08,129 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 15:01:08,130 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/.tmp/f1/99f4454770fa45a795185ec47ffcf98a as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1/99f4454770fa45a795185ec47ffcf98a 2023-02-18 15:01:08,136 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1/99f4454770fa45a795185ec47ffcf98a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,137 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/.tmp/f2/447feae449bb41af89ec325f7179dd66 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2/447feae449bb41af89ec325f7179dd66 2023-02-18 15:01:08,142 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2/447feae449bb41af89ec325f7179dd66, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,143 INFO [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 30da3b3610442bb6d6fe624fcec2de90 in 75ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:08,143 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 30da3b3610442bb6d6fe624fcec2de90: 2023-02-18 15:01:08,143 DEBUG [rs(jenkins-hbase4.apache.org,46721,1676732459680)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:08,143 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 15:01:08,143 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 15:01:08,144 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,144 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 15:01:08,144 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46721,1676732459680' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 15:01:08,146 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,146 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:08,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:08,147 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,147 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:08,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:08,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:08,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:08,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:08,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46721,1676732459680' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 15:01:08,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24345068[Count = 1] remaining members to acquire global barrier 2023-02-18 15:01:08,335 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/.tmp/f1/ce8fa96f302b4e7780ac23ef16b07878 2023-02-18 15:01:08,358 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/.tmp/f2/081f5da0da4847e5bbae30f205a54c4c 2023-02-18 15:01:08,364 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/.tmp/f1/ce8fa96f302b4e7780ac23ef16b07878 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1/ce8fa96f302b4e7780ac23ef16b07878 2023-02-18 15:01:08,369 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1/ce8fa96f302b4e7780ac23ef16b07878, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,370 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/.tmp/f2/081f5da0da4847e5bbae30f205a54c4c as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2/081f5da0da4847e5bbae30f205a54c4c 2023-02-18 15:01:08,376 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2/081f5da0da4847e5bbae30f205a54c4c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:08,377 INFO [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bc5da7d6cfb34e088b8cc688b083d74b in 541ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:08,377 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bc5da7d6cfb34e088b8cc688b083d74b: 2023-02-18 15:01:08,377 DEBUG [rs(jenkins-hbase4.apache.org,46385,1676732459629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:08,378 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 15:01:08,378 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 15:01:08,378 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,378 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 15:01:08,378 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46385,1676732459629' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 15:01:08,380 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,380 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:08,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:08,380 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,380 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:08,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46385,1676732459629' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 15:01:08,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24345068[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:08,383 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-18 15:01:08,383 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,386 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,386 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,386 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 15:01:08,387 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 15:01:08,387 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,387 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 15:01:08,387 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46385,1676732459629' in zk 2023-02-18 15:01:08,387 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 15:01:08,387 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46721,1676732459680' in zk 2023-02-18 15:01:08,387 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,387 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:08,389 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 15:01:08,389 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,389 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 15:01:08,389 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:08,389 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,389 DEBUG [member: 'jenkins-hbase4.apache.org,46721,1676732459680' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 15:01:08,389 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:08,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:08,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:08,390 DEBUG [member: 'jenkins-hbase4.apache.org,46385,1676732459629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 15:01:08,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,46721,1676732459680': 2023-02-18 15:01:08,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46721,1676732459680' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-18 15:01:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:08,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:08,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,46385,1676732459629': 2023-02-18 15:01:08,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46385,1676732459629' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-18 15:01:08,398 INFO [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-18 15:01:08,398 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:08,398 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:08,398 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-18 15:01:08,398 INFO [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 15:01:08,400 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:08,400 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:08,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:08,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:08,400 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:08,400 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:08,401 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,400 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:08,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:08,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:08,401 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:08,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:08,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:08,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,403 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:08,404 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,409 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,409 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:08,409 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,409 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:08,409 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:08,409 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:08,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:08,409 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:08,410 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:08,410 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:08,409 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,410 DEBUG [(jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:08,410 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-18 15:01:08,410 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:08,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:08,410 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:08,410 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 15:01:08,410 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:08,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:08,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:08,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:08,412 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:08,413 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 15:01:08,513 DEBUG [Listener at localhost/42771] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 15:01:08,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 15:01:08,591 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 15:01:08,591 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-18 15:01:08,618 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/hadoop-7864579551905772329.jar 2023-02-18 15:01:08,634 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676732465306 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:08,635 DEBUG [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce 2023-02-18 15:01:08,636 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(239): region to add: 205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:08,636 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(239): region to add: 39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:08,636 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(239): region to add: e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:08,636 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(239): region to add: bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:08,636 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(239): region to add: 7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:08,636 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(239): region to add: 6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:08,636 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(239): region to add: 3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:08,636 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(239): region to add: 2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:08,636 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(239): region to add: 0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:08,637 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(239): region to add: 30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:08,637 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(585): clone region=205bb2a0c3f98ef17e15352ea574c983 as 205bb2a0c3f98ef17e15352ea574c983 in snapshot testWithMapReduceMultiRegion 2023-02-18 15:01:08,637 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(585): clone region=39d83cfde4a830e40ab428208c2cedd3 as 39d83cfde4a830e40ab428208c2cedd3 in snapshot testWithMapReduceMultiRegion 2023-02-18 15:01:08,637 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(585): clone region=e47b3c30328aecb262c445857eab5a45 as e47b3c30328aecb262c445857eab5a45 in snapshot testWithMapReduceMultiRegion 2023-02-18 15:01:08,637 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(585): clone region=bc5da7d6cfb34e088b8cc688b083d74b as bc5da7d6cfb34e088b8cc688b083d74b in snapshot testWithMapReduceMultiRegion 2023-02-18 15:01:08,637 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(585): clone region=7d643e504718c341f5d23797f65f832c as 7d643e504718c341f5d23797f65f832c in snapshot testWithMapReduceMultiRegion 2023-02-18 15:01:08,637 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(585): clone region=6a6e1ad761fbe4daf556174450868f9a as 6a6e1ad761fbe4daf556174450868f9a in snapshot testWithMapReduceMultiRegion 2023-02-18 15:01:08,637 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(585): clone region=3f21eb7f443add362b469d2c02a35430 as 3f21eb7f443add362b469d2c02a35430 in snapshot testWithMapReduceMultiRegion 2023-02-18 15:01:08,637 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(585): clone region=2e392bd4cb4c185ea77b956fdf9dd990 as 2e392bd4cb4c185ea77b956fdf9dd990 in snapshot testWithMapReduceMultiRegion 2023-02-18 15:01:08,637 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(585): clone region=0a9e49a654a25d33ce2c87eb8d60e134 as 0a9e49a654a25d33ce2c87eb8d60e134 in snapshot testWithMapReduceMultiRegion 2023-02-18 15:01:08,637 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(585): clone region=30da3b3610442bb6d6fe624fcec2de90 as 30da3b3610442bb6d6fe624fcec2de90 in snapshot testWithMapReduceMultiRegion 2023-02-18 15:01:08,642 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 3f21eb7f443add362b469d2c02a35430, NAME => 'testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,642 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 7d643e504718c341f5d23797f65f832c, NAME => 'testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,643 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => e47b3c30328aecb262c445857eab5a45, NAME => 'testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,643 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 39d83cfde4a830e40ab428208c2cedd3, NAME => 'testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,643 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => bc5da7d6cfb34e088b8cc688b083d74b, NAME => 'testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,643 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 6a6e1ad761fbe4daf556174450868f9a, NAME => 'testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,644 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 2e392bd4cb4c185ea77b956fdf9dd990, NAME => 'testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,644 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 205bb2a0c3f98ef17e15352ea574c983, NAME => 'testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,677 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:08,678 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e183eaf4ccb04554a9987e6895d8e412 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,685 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:08,686 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 458a6a88c51741e0abb692dad3965479 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,692 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b79cac028cb748f5a77aa60c010e435c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,692 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:08,692 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 2e392bd4cb4c185ea77b956fdf9dd990, disabling compactions & flushes 2023-02-18 15:01:08,692 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:08,693 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:08,693 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. after waiting 0 ms 2023-02-18 15:01:08,693 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:08,693 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:08,693 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 2e392bd4cb4c185ea77b956fdf9dd990: 2023-02-18 15:01:08,693 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8ded650abc0b4f84877abe83dd95663d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,693 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 0a9e49a654a25d33ce2c87eb8d60e134, NAME => 'testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,700 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:08,700 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2f81b6d0afae432fa62e9aae7006af12 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,710 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing e47b3c30328aecb262c445857eab5a45, disabling compactions & flushes 2023-02-18 15:01:08,710 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:08,710 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:08,710 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. after waiting 0 ms 2023-02-18 15:01:08,710 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:08,710 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:08,710 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for e47b3c30328aecb262c445857eab5a45: 2023-02-18 15:01:08,710 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:08,711 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 30da3b3610442bb6d6fe624fcec2de90, NAME => 'testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,711 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b009c55e1b0944ea86cec96a47534d2f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,711 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing bc5da7d6cfb34e088b8cc688b083d74b, disabling compactions & flushes 2023-02-18 15:01:08,711 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:08,711 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:08,711 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. after waiting 0 ms 2023-02-18 15:01:08,711 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:08,711 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:08,711 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for bc5da7d6cfb34e088b8cc688b083d74b: 2023-02-18 15:01:08,716 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a6c561242dde499db123c5339bbaf54a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,716 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:08,716 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 94632aa0690e4107aa37e0385115b5a2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,721 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 07d133cb500949f6b803955ff9730fff from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,721 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:08,721 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0d0c35ca19cd498191e2ab71693a450f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,732 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 39d83cfde4a830e40ab428208c2cedd3, disabling compactions & flushes 2023-02-18 15:01:08,733 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:08,733 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:08,733 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:08,733 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 938dbe1dee8c4c20847fe98b5c0260a3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,735 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:08,735 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 0a9e49a654a25d33ce2c87eb8d60e134, disabling compactions & flushes 2023-02-18 15:01:08,735 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:08,735 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:08,735 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. after waiting 0 ms 2023-02-18 15:01:08,735 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:08,735 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:08,735 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 0a9e49a654a25d33ce2c87eb8d60e134: 2023-02-18 15:01:08,736 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 7d643e504718c341f5d23797f65f832c, disabling compactions & flushes 2023-02-18 15:01:08,736 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:08,736 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:08,736 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. after waiting 0 ms 2023-02-18 15:01:08,736 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:08,736 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:08,736 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 7d643e504718c341f5d23797f65f832c: 2023-02-18 15:01:08,732 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e84274a674234784a17c7fe62cdaf813 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,733 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. after waiting 0 ms 2023-02-18 15:01:08,737 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:08,737 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:08,737 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 39d83cfde4a830e40ab428208c2cedd3: 2023-02-18 15:01:08,740 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3811bb0615034bef8bc4d720562c44c5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,740 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1f581c3952b54bae9cba0185c1acb596 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,741 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 3f21eb7f443add362b469d2c02a35430, disabling compactions & flushes 2023-02-18 15:01:08,742 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:08,742 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:08,742 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. after waiting 0 ms 2023-02-18 15:01:08,742 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:08,742 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:08,742 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 3f21eb7f443add362b469d2c02a35430: 2023-02-18 15:01:08,744 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 6a6e1ad761fbe4daf556174450868f9a, disabling compactions & flushes 2023-02-18 15:01:08,744 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:08,744 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:08,744 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 205bb2a0c3f98ef17e15352ea574c983, disabling compactions & flushes 2023-02-18 15:01:08,744 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. after waiting 0 ms 2023-02-18 15:01:08,744 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:08,744 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:08,744 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:08,744 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:08,744 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. after waiting 0 ms 2023-02-18 15:01:08,745 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:08,745 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:08,745 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 205bb2a0c3f98ef17e15352ea574c983: 2023-02-18 15:01:08,745 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 6a6e1ad761fbe4daf556174450868f9a: 2023-02-18 15:01:08,746 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:08,746 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 78c4b72b4fe64762a4e6edeb9b0bd05e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,748 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1c85c3f1479643aeaa0048d27054bc27 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 15:01:08,751 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 30da3b3610442bb6d6fe624fcec2de90, disabling compactions & flushes 2023-02-18 15:01:08,751 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:08,751 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:08,751 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. after waiting 0 ms 2023-02-18 15:01:08,751 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:08,751 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:08,751 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 30da3b3610442bb6d6fe624fcec2de90: 2023-02-18 15:01:08,751 INFO [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676732465306 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:08,752 DEBUG [Listener at localhost/42771] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,752 DEBUG [Listener at localhost/42771] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898 2023-02-18 15:01:08,753 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-data/ 2023-02-18 15:01:08,753 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |----default/ 2023-02-18 15:01:08,754 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-18 15:01:08,754 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |----------0a9e49a654a25d33ce2c87eb8d60e134/ 2023-02-18 15:01:08,755 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:08,755 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |----------205bb2a0c3f98ef17e15352ea574c983/ 2023-02-18 15:01:08,755 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:08,755 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:08,756 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=205bb2a0c3f98ef17e15352ea574c983-94632aa0690e4107aa37e0385115b5a2 2023-02-18 15:01:08,756 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:08,756 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=205bb2a0c3f98ef17e15352ea574c983-3811bb0615034bef8bc4d720562c44c5 2023-02-18 15:01:08,756 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |----------2e392bd4cb4c185ea77b956fdf9dd990/ 2023-02-18 15:01:08,757 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:08,757 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |----------30da3b3610442bb6d6fe624fcec2de90/ 2023-02-18 15:01:08,757 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:08,758 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:08,758 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=30da3b3610442bb6d6fe624fcec2de90-78c4b72b4fe64762a4e6edeb9b0bd05e 2023-02-18 15:01:08,758 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:08,759 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=30da3b3610442bb6d6fe624fcec2de90-1c85c3f1479643aeaa0048d27054bc27 2023-02-18 15:01:08,759 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |----------39d83cfde4a830e40ab428208c2cedd3/ 2023-02-18 15:01:08,759 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:08,760 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:08,760 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=39d83cfde4a830e40ab428208c2cedd3-b009c55e1b0944ea86cec96a47534d2f 2023-02-18 15:01:08,760 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:08,761 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=39d83cfde4a830e40ab428208c2cedd3-07d133cb500949f6b803955ff9730fff 2023-02-18 15:01:08,761 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |----------3f21eb7f443add362b469d2c02a35430/ 2023-02-18 15:01:08,761 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:08,762 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:08,762 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=3f21eb7f443add362b469d2c02a35430-0d0c35ca19cd498191e2ab71693a450f 2023-02-18 15:01:08,762 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:08,763 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=3f21eb7f443add362b469d2c02a35430-e84274a674234784a17c7fe62cdaf813 2023-02-18 15:01:08,763 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |----------6a6e1ad761fbe4daf556174450868f9a/ 2023-02-18 15:01:08,763 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:08,763 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:08,764 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=6a6e1ad761fbe4daf556174450868f9a-938dbe1dee8c4c20847fe98b5c0260a3 2023-02-18 15:01:08,764 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:08,765 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=6a6e1ad761fbe4daf556174450868f9a-1f581c3952b54bae9cba0185c1acb596 2023-02-18 15:01:08,765 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |----------7d643e504718c341f5d23797f65f832c/ 2023-02-18 15:01:08,765 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:08,765 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:08,766 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=7d643e504718c341f5d23797f65f832c-2f81b6d0afae432fa62e9aae7006af12 2023-02-18 15:01:08,766 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:08,767 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=7d643e504718c341f5d23797f65f832c-a6c561242dde499db123c5339bbaf54a 2023-02-18 15:01:08,767 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |----------bc5da7d6cfb34e088b8cc688b083d74b/ 2023-02-18 15:01:08,767 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:08,767 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:08,768 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=bc5da7d6cfb34e088b8cc688b083d74b-e183eaf4ccb04554a9987e6895d8e412 2023-02-18 15:01:08,768 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:08,769 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=bc5da7d6cfb34e088b8cc688b083d74b-b79cac028cb748f5a77aa60c010e435c 2023-02-18 15:01:08,769 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |----------e47b3c30328aecb262c445857eab5a45/ 2023-02-18 15:01:08,769 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:08,769 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:08,770 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=e47b3c30328aecb262c445857eab5a45-458a6a88c51741e0abb692dad3965479 2023-02-18 15:01:08,770 DEBUG [Listener at localhost/42771] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:08,770 DEBUG [Listener at localhost/42771] util.CommonFSUtils(702): |----------------testWithMapReduce=e47b3c30328aecb262c445857eab5a45-8ded650abc0b4f84877abe83dd95663d 2023-02-18 15:01:08,779 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:08,779 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:08,780 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:08,780 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:09,687 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/hadoop-4926498064071556125.jar 2023-02-18 15:01:09,687 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:09,688 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:09,754 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/hadoop-5189822786232173974.jar 2023-02-18 15:01:09,755 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:09,755 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:09,756 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:09,756 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:09,757 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:09,757 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:09,757 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-18 15:01:09,758 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-18 15:01:09,758 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-18 15:01:09,759 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-18 15:01:09,759 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-18 15:01:09,760 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-18 15:01:09,760 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-18 15:01:09,760 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-18 15:01:09,761 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-18 15:01:09,762 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-18 15:01:09,767 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:09,768 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 15:01:09,768 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 15:01:09,769 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 15:01:09,769 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 15:01:09,840 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/hadoop-3436278018566359924.jar 2023-02-18 15:01:09,840 DEBUG [Listener at localhost/42771] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 15:01:09,895 WARN [Listener at localhost/42771] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-18 15:01:09,908 WARN [Listener at localhost/42771] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-18 15:01:09,922 INFO [Listener at localhost/42771] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 15:01:10,289 WARN [Listener at localhost/42771] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/mapreduce.cluster.local.dir/1676732470206/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-18 15:01:10,289 WARN [Listener at localhost/42771] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/mapreduce.cluster.local.dir/1676732470206/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-18 15:01:10,492 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:10,492 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:10,496 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:10,498 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:10,500 DEBUG [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/f1 2023-02-18 15:01:10,501 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a9e49a654a25d33ce2c87eb8d60e134 columnFamilyName f1 2023-02-18 15:01:10,501 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] regionserver.HStore(310): Store=0a9e49a654a25d33ce2c87eb8d60e134/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:10,501 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:10,503 DEBUG [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/f2 2023-02-18 15:01:10,503 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a9e49a654a25d33ce2c87eb8d60e134 columnFamilyName f2 2023-02-18 15:01:10,504 INFO [StoreOpener-0a9e49a654a25d33ce2c87eb8d60e134-1] regionserver.HStore(310): Store=0a9e49a654a25d33ce2c87eb8d60e134/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:10,504 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:10,504 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0a9e49a654a25d33ce2c87eb8d60e134; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69736259, jitterRate=0.03915123641490936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:10,504 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0a9e49a654a25d33ce2c87eb8d60e134: 2023-02-18 15:01:10,546 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0a9e49a654a25d33ce2c87eb8d60e134, disabling compactions & flushes 2023-02-18 15:01:10,547 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:10,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:10,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. after waiting 0 ms 2023-02-18 15:01:10,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:10,547 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:10,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0a9e49a654a25d33ce2c87eb8d60e134: 2023-02-18 15:01:10,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:10,563 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:10,569 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:10,571 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:10,572 DEBUG [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1 2023-02-18 15:01:10,573 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 205bb2a0c3f98ef17e15352ea574c983 columnFamilyName f1 2023-02-18 15:01:10,582 DEBUG [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1/testWithMapReduce=205bb2a0c3f98ef17e15352ea574c983-94632aa0690e4107aa37e0385115b5a2 2023-02-18 15:01:10,583 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] regionserver.HStore(310): Store=205bb2a0c3f98ef17e15352ea574c983/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:10,583 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:10,584 DEBUG [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2 2023-02-18 15:01:10,585 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 205bb2a0c3f98ef17e15352ea574c983 columnFamilyName f2 2023-02-18 15:01:10,591 DEBUG [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2/testWithMapReduce=205bb2a0c3f98ef17e15352ea574c983-3811bb0615034bef8bc4d720562c44c5 2023-02-18 15:01:10,591 INFO [StoreOpener-205bb2a0c3f98ef17e15352ea574c983-1] regionserver.HStore(310): Store=205bb2a0c3f98ef17e15352ea574c983/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:10,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:10,592 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 205bb2a0c3f98ef17e15352ea574c983; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64859286, jitterRate=-0.03352132439613342}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:10,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 205bb2a0c3f98ef17e15352ea574c983: 2023-02-18 15:01:10,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 205bb2a0c3f98ef17e15352ea574c983, disabling compactions & flushes 2023-02-18 15:01:10,773 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:10,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:10,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. after waiting 0 ms 2023-02-18 15:01:10,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:10,779 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:10,779 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 205bb2a0c3f98ef17e15352ea574c983: 2023-02-18 15:01:10,784 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:10,784 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:10,788 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:10,792 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:10,794 DEBUG [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/f1 2023-02-18 15:01:10,795 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e392bd4cb4c185ea77b956fdf9dd990 columnFamilyName f1 2023-02-18 15:01:10,795 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] regionserver.HStore(310): Store=2e392bd4cb4c185ea77b956fdf9dd990/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:10,796 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:10,797 DEBUG [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/f2 2023-02-18 15:01:10,798 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e392bd4cb4c185ea77b956fdf9dd990 columnFamilyName f2 2023-02-18 15:01:10,798 INFO [StoreOpener-2e392bd4cb4c185ea77b956fdf9dd990-1] regionserver.HStore(310): Store=2e392bd4cb4c185ea77b956fdf9dd990/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:10,799 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:10,799 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2e392bd4cb4c185ea77b956fdf9dd990; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64904395, jitterRate=-0.03284914791584015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:10,799 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2e392bd4cb4c185ea77b956fdf9dd990: 2023-02-18 15:01:10,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2e392bd4cb4c185ea77b956fdf9dd990, disabling compactions & flushes 2023-02-18 15:01:10,816 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:10,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:10,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. after waiting 0 ms 2023-02-18 15:01:10,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:10,818 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:10,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2e392bd4cb4c185ea77b956fdf9dd990: 2023-02-18 15:01:10,822 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:10,823 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:10,824 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:10,832 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:10,834 DEBUG [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1 2023-02-18 15:01:10,834 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f21eb7f443add362b469d2c02a35430 columnFamilyName f1 2023-02-18 15:01:10,844 DEBUG [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1/testWithMapReduce=3f21eb7f443add362b469d2c02a35430-0d0c35ca19cd498191e2ab71693a450f 2023-02-18 15:01:10,845 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] regionserver.HStore(310): Store=3f21eb7f443add362b469d2c02a35430/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:10,845 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:10,849 DEBUG [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2 2023-02-18 15:01:10,849 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f21eb7f443add362b469d2c02a35430 columnFamilyName f2 2023-02-18 15:01:10,858 DEBUG [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2/testWithMapReduce=3f21eb7f443add362b469d2c02a35430-e84274a674234784a17c7fe62cdaf813 2023-02-18 15:01:10,859 INFO [StoreOpener-3f21eb7f443add362b469d2c02a35430-1] regionserver.HStore(310): Store=3f21eb7f443add362b469d2c02a35430/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:10,859 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:10,859 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3f21eb7f443add362b469d2c02a35430; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62207469, jitterRate=-0.07303647696971893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:10,859 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3f21eb7f443add362b469d2c02a35430: 2023-02-18 15:01:10,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3f21eb7f443add362b469d2c02a35430, disabling compactions & flushes 2023-02-18 15:01:10,907 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:10,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:10,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. after waiting 0 ms 2023-02-18 15:01:10,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:10,917 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:10,917 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3f21eb7f443add362b469d2c02a35430: 2023-02-18 15:01:10,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:10,926 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:10,932 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:10,936 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:10,937 DEBUG [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1 2023-02-18 15:01:10,938 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30da3b3610442bb6d6fe624fcec2de90 columnFamilyName f1 2023-02-18 15:01:10,950 DEBUG [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1/testWithMapReduce=30da3b3610442bb6d6fe624fcec2de90-78c4b72b4fe64762a4e6edeb9b0bd05e 2023-02-18 15:01:10,951 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] regionserver.HStore(310): Store=30da3b3610442bb6d6fe624fcec2de90/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:10,951 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:10,952 DEBUG [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2 2023-02-18 15:01:10,952 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30da3b3610442bb6d6fe624fcec2de90 columnFamilyName f2 2023-02-18 15:01:10,961 DEBUG [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2/testWithMapReduce=30da3b3610442bb6d6fe624fcec2de90-1c85c3f1479643aeaa0048d27054bc27 2023-02-18 15:01:10,961 INFO [StoreOpener-30da3b3610442bb6d6fe624fcec2de90-1] regionserver.HStore(310): Store=30da3b3610442bb6d6fe624fcec2de90/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:10,961 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:10,961 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 30da3b3610442bb6d6fe624fcec2de90; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74219803, jitterRate=0.10596124827861786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:10,962 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 30da3b3610442bb6d6fe624fcec2de90: 2023-02-18 15:01:11,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 30da3b3610442bb6d6fe624fcec2de90, disabling compactions & flushes 2023-02-18 15:01:11,021 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:11,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:11,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. after waiting 0 ms 2023-02-18 15:01:11,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:11,046 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:11,046 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 30da3b3610442bb6d6fe624fcec2de90: 2023-02-18 15:01:11,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:11,056 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:11,066 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:11,070 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:11,071 DEBUG [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1 2023-02-18 15:01:11,073 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39d83cfde4a830e40ab428208c2cedd3 columnFamilyName f1 2023-02-18 15:01:11,094 DEBUG [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1/testWithMapReduce=39d83cfde4a830e40ab428208c2cedd3-b009c55e1b0944ea86cec96a47534d2f 2023-02-18 15:01:11,095 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] regionserver.HStore(310): Store=39d83cfde4a830e40ab428208c2cedd3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:11,095 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:11,096 DEBUG [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2 2023-02-18 15:01:11,097 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39d83cfde4a830e40ab428208c2cedd3 columnFamilyName f2 2023-02-18 15:01:11,106 DEBUG [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2/testWithMapReduce=39d83cfde4a830e40ab428208c2cedd3-07d133cb500949f6b803955ff9730fff 2023-02-18 15:01:11,106 INFO [StoreOpener-39d83cfde4a830e40ab428208c2cedd3-1] regionserver.HStore(310): Store=39d83cfde4a830e40ab428208c2cedd3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:11,107 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:11,107 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 39d83cfde4a830e40ab428208c2cedd3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74824022, jitterRate=0.1149648129940033}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:11,107 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 39d83cfde4a830e40ab428208c2cedd3: 2023-02-18 15:01:11,245 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 39d83cfde4a830e40ab428208c2cedd3, disabling compactions & flushes 2023-02-18 15:01:11,246 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:11,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:11,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. after waiting 0 ms 2023-02-18 15:01:11,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:11,249 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:11,250 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 39d83cfde4a830e40ab428208c2cedd3: 2023-02-18 15:01:11,256 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:11,256 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:11,260 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:11,263 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:11,265 DEBUG [StoreOpener-7d643e504718c341f5d23797f65f832c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1 2023-02-18 15:01:11,265 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d643e504718c341f5d23797f65f832c columnFamilyName f1 2023-02-18 15:01:11,276 DEBUG [StoreOpener-7d643e504718c341f5d23797f65f832c-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1/testWithMapReduce=7d643e504718c341f5d23797f65f832c-2f81b6d0afae432fa62e9aae7006af12 2023-02-18 15:01:11,277 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] regionserver.HStore(310): Store=7d643e504718c341f5d23797f65f832c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:11,277 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:11,278 DEBUG [StoreOpener-7d643e504718c341f5d23797f65f832c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2 2023-02-18 15:01:11,278 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d643e504718c341f5d23797f65f832c columnFamilyName f2 2023-02-18 15:01:11,285 DEBUG [StoreOpener-7d643e504718c341f5d23797f65f832c-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2/testWithMapReduce=7d643e504718c341f5d23797f65f832c-a6c561242dde499db123c5339bbaf54a 2023-02-18 15:01:11,285 INFO [StoreOpener-7d643e504718c341f5d23797f65f832c-1] regionserver.HStore(310): Store=7d643e504718c341f5d23797f65f832c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:11,285 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:11,285 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7d643e504718c341f5d23797f65f832c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70235787, jitterRate=0.046594783663749695}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:11,285 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7d643e504718c341f5d23797f65f832c: 2023-02-18 15:01:11,340 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7d643e504718c341f5d23797f65f832c, disabling compactions & flushes 2023-02-18 15:01:11,340 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:11,340 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:11,340 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. after waiting 0 ms 2023-02-18 15:01:11,340 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:11,353 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:11,353 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7d643e504718c341f5d23797f65f832c: 2023-02-18 15:01:11,360 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:11,360 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:11,372 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:11,377 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:11,378 DEBUG [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1 2023-02-18 15:01:11,379 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc5da7d6cfb34e088b8cc688b083d74b columnFamilyName f1 2023-02-18 15:01:11,387 DEBUG [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1/testWithMapReduce=bc5da7d6cfb34e088b8cc688b083d74b-e183eaf4ccb04554a9987e6895d8e412 2023-02-18 15:01:11,388 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] regionserver.HStore(310): Store=bc5da7d6cfb34e088b8cc688b083d74b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:11,388 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:11,389 DEBUG [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2 2023-02-18 15:01:11,389 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc5da7d6cfb34e088b8cc688b083d74b columnFamilyName f2 2023-02-18 15:01:11,397 DEBUG [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2/testWithMapReduce=bc5da7d6cfb34e088b8cc688b083d74b-b79cac028cb748f5a77aa60c010e435c 2023-02-18 15:01:11,397 INFO [StoreOpener-bc5da7d6cfb34e088b8cc688b083d74b-1] regionserver.HStore(310): Store=bc5da7d6cfb34e088b8cc688b083d74b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:11,397 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:11,398 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bc5da7d6cfb34e088b8cc688b083d74b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66327625, jitterRate=-0.011641368269920349}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:11,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bc5da7d6cfb34e088b8cc688b083d74b: 2023-02-18 15:01:11,437 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bc5da7d6cfb34e088b8cc688b083d74b, disabling compactions & flushes 2023-02-18 15:01:11,437 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:11,437 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:11,437 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. after waiting 0 ms 2023-02-18 15:01:11,437 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:11,442 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:11,442 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bc5da7d6cfb34e088b8cc688b083d74b: 2023-02-18 15:01:11,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:11,447 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:11,452 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:11,455 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:11,456 DEBUG [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1 2023-02-18 15:01:11,457 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a6e1ad761fbe4daf556174450868f9a columnFamilyName f1 2023-02-18 15:01:11,463 DEBUG [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1/testWithMapReduce=6a6e1ad761fbe4daf556174450868f9a-938dbe1dee8c4c20847fe98b5c0260a3 2023-02-18 15:01:11,463 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] regionserver.HStore(310): Store=6a6e1ad761fbe4daf556174450868f9a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:11,464 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:11,465 DEBUG [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2 2023-02-18 15:01:11,465 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a6e1ad761fbe4daf556174450868f9a columnFamilyName f2 2023-02-18 15:01:11,472 DEBUG [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2/testWithMapReduce=6a6e1ad761fbe4daf556174450868f9a-1f581c3952b54bae9cba0185c1acb596 2023-02-18 15:01:11,472 INFO [StoreOpener-6a6e1ad761fbe4daf556174450868f9a-1] regionserver.HStore(310): Store=6a6e1ad761fbe4daf556174450868f9a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:11,472 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:11,472 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6a6e1ad761fbe4daf556174450868f9a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69450163, jitterRate=0.034888073801994324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:11,473 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6a6e1ad761fbe4daf556174450868f9a: 2023-02-18 15:01:11,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6a6e1ad761fbe4daf556174450868f9a, disabling compactions & flushes 2023-02-18 15:01:11,514 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:11,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:11,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. after waiting 0 ms 2023-02-18 15:01:11,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:11,519 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:11,519 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6a6e1ad761fbe4daf556174450868f9a: 2023-02-18 15:01:11,524 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:11,524 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:11,526 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:11,528 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:11,529 DEBUG [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1 2023-02-18 15:01:11,530 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e47b3c30328aecb262c445857eab5a45 columnFamilyName f1 2023-02-18 15:01:11,541 DEBUG [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1/testWithMapReduce=e47b3c30328aecb262c445857eab5a45-458a6a88c51741e0abb692dad3965479 2023-02-18 15:01:11,541 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] regionserver.HStore(310): Store=e47b3c30328aecb262c445857eab5a45/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:11,542 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:11,543 DEBUG [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2 2023-02-18 15:01:11,543 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e47b3c30328aecb262c445857eab5a45 columnFamilyName f2 2023-02-18 15:01:11,549 DEBUG [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] regionserver.HStore(539): loaded hdfs://localhost:37253/user/jenkins/test-data/67e64fe0-dac7-bff1-8caa-56b5b0d5c4ed/testWithMapReduceMultiRegion/b0b9fea5-dc27-4312-a48b-b1e1656ea898/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2/testWithMapReduce=e47b3c30328aecb262c445857eab5a45-8ded650abc0b4f84877abe83dd95663d 2023-02-18 15:01:11,549 INFO [StoreOpener-e47b3c30328aecb262c445857eab5a45-1] regionserver.HStore(310): Store=e47b3c30328aecb262c445857eab5a45/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:11,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:11,550 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e47b3c30328aecb262c445857eab5a45; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67849945, jitterRate=0.011042967438697815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:11,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e47b3c30328aecb262c445857eab5a45: 2023-02-18 15:01:11,626 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e47b3c30328aecb262c445857eab5a45, disabling compactions & flushes 2023-02-18 15:01:11,626 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:11,626 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:11,626 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. after waiting 0 ms 2023-02-18 15:01:11,626 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:11,638 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:11,638 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e47b3c30328aecb262c445857eab5a45: 2023-02-18 15:01:12,392 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-18 15:01:12,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-18 15:01:12,400 INFO [Listener at localhost/42771] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 15:01:12,400 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-18 15:01:12,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-18 15:01:12,413 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732472413"}]},"ts":"1676732472413"} 2023-02-18 15:01:12,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 15:01:12,416 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-18 15:01:12,419 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-18 15:01:12,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0a9e49a654a25d33ce2c87eb8d60e134, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7d643e504718c341f5d23797f65f832c, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=39d83cfde4a830e40ab428208c2cedd3, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=30da3b3610442bb6d6fe624fcec2de90, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bc5da7d6cfb34e088b8cc688b083d74b, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e47b3c30328aecb262c445857eab5a45, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3f21eb7f443add362b469d2c02a35430, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=205bb2a0c3f98ef17e15352ea574c983, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6a6e1ad761fbe4daf556174450868f9a, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2e392bd4cb4c185ea77b956fdf9dd990, UNASSIGN}] 2023-02-18 15:01:12,424 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2e392bd4cb4c185ea77b956fdf9dd990, UNASSIGN 2023-02-18 15:01:12,424 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=205bb2a0c3f98ef17e15352ea574c983, UNASSIGN 2023-02-18 15:01:12,425 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3f21eb7f443add362b469d2c02a35430, UNASSIGN 2023-02-18 15:01:12,425 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6a6e1ad761fbe4daf556174450868f9a, UNASSIGN 2023-02-18 15:01:12,425 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e47b3c30328aecb262c445857eab5a45, UNASSIGN 2023-02-18 15:01:12,426 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2e392bd4cb4c185ea77b956fdf9dd990, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:12,426 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=6a6e1ad761fbe4daf556174450868f9a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:12,426 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=e47b3c30328aecb262c445857eab5a45, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:12,426 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732472426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732472426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732472426"}]},"ts":"1676732472426"} 2023-02-18 15:01:12,426 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732472426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732472426"}]},"ts":"1676732472426"} 2023-02-18 15:01:12,427 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=205bb2a0c3f98ef17e15352ea574c983, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:12,427 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732472426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732472426"}]},"ts":"1676732472426"} 2023-02-18 15:01:12,426 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3f21eb7f443add362b469d2c02a35430, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:12,427 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732472426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732472426"}]},"ts":"1676732472426"} 2023-02-18 15:01:12,427 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732472426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732472426"}]},"ts":"1676732472426"} 2023-02-18 15:01:12,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=42, state=RUNNABLE; CloseRegionProcedure 6a6e1ad761fbe4daf556174450868f9a, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:12,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; CloseRegionProcedure 2e392bd4cb4c185ea77b956fdf9dd990, server=jenkins-hbase4.apache.org,46385,1676732459629}] 2023-02-18 15:01:12,431 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=39, state=RUNNABLE; CloseRegionProcedure e47b3c30328aecb262c445857eab5a45, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:12,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=40, state=RUNNABLE; CloseRegionProcedure 3f21eb7f443add362b469d2c02a35430, server=jenkins-hbase4.apache.org,46385,1676732459629}] 2023-02-18 15:01:12,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=41, state=RUNNABLE; CloseRegionProcedure 205bb2a0c3f98ef17e15352ea574c983, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:12,439 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bc5da7d6cfb34e088b8cc688b083d74b, UNASSIGN 2023-02-18 15:01:12,440 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=30da3b3610442bb6d6fe624fcec2de90, UNASSIGN 2023-02-18 15:01:12,440 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7d643e504718c341f5d23797f65f832c, UNASSIGN 2023-02-18 15:01:12,440 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=39d83cfde4a830e40ab428208c2cedd3, UNASSIGN 2023-02-18 15:01:12,440 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0a9e49a654a25d33ce2c87eb8d60e134, UNASSIGN 2023-02-18 15:01:12,441 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bc5da7d6cfb34e088b8cc688b083d74b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:12,441 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472441"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732472441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732472441"}]},"ts":"1676732472441"} 2023-02-18 15:01:12,441 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=30da3b3610442bb6d6fe624fcec2de90, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:12,441 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472441"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732472441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732472441"}]},"ts":"1676732472441"} 2023-02-18 15:01:12,442 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=7d643e504718c341f5d23797f65f832c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:12,442 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732472442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732472442"}]},"ts":"1676732472442"} 2023-02-18 15:01:12,442 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=0a9e49a654a25d33ce2c87eb8d60e134, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:12,442 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=39d83cfde4a830e40ab428208c2cedd3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:12,443 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732472442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732472442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732472442"}]},"ts":"1676732472442"} 2023-02-18 15:01:12,443 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732472442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732472442"}]},"ts":"1676732472442"} 2023-02-18 15:01:12,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure bc5da7d6cfb34e088b8cc688b083d74b, server=jenkins-hbase4.apache.org,46385,1676732459629}] 2023-02-18 15:01:12,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 30da3b3610442bb6d6fe624fcec2de90, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:12,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=35, state=RUNNABLE; CloseRegionProcedure 7d643e504718c341f5d23797f65f832c, server=jenkins-hbase4.apache.org,46385,1676732459629}] 2023-02-18 15:01:12,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=34, state=RUNNABLE; CloseRegionProcedure 0a9e49a654a25d33ce2c87eb8d60e134, server=jenkins-hbase4.apache.org,46385,1676732459629}] 2023-02-18 15:01:12,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=36, state=RUNNABLE; CloseRegionProcedure 39d83cfde4a830e40ab428208c2cedd3, server=jenkins-hbase4.apache.org,46721,1676732459680}] 2023-02-18 15:01:12,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 15:01:12,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:12,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:12,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0a9e49a654a25d33ce2c87eb8d60e134, disabling compactions & flushes 2023-02-18 15:01:12,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 205bb2a0c3f98ef17e15352ea574c983, disabling compactions & flushes 2023-02-18 15:01:12,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:12,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:12,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:12,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:12,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. after waiting 0 ms 2023-02-18 15:01:12,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. after waiting 0 ms 2023-02-18 15:01:12,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:12,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:12,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 15:01:12,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134. 2023-02-18 15:01:12,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0a9e49a654a25d33ce2c87eb8d60e134: 2023-02-18 15:01:12,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:12,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983. 2023-02-18 15:01:12,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 205bb2a0c3f98ef17e15352ea574c983: 2023-02-18 15:01:12,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:12,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:12,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7d643e504718c341f5d23797f65f832c, disabling compactions & flushes 2023-02-18 15:01:12,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:12,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:12,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. after waiting 0 ms 2023-02-18 15:01:12,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:12,624 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=0a9e49a654a25d33ce2c87eb8d60e134, regionState=CLOSED 2023-02-18 15:01:12,624 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732472624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732472624"}]},"ts":"1676732472624"} 2023-02-18 15:01:12,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:12,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:12,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 30da3b3610442bb6d6fe624fcec2de90, disabling compactions & flushes 2023-02-18 15:01:12,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:12,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:12,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. after waiting 0 ms 2023-02-18 15:01:12,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:12,625 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=205bb2a0c3f98ef17e15352ea574c983, regionState=CLOSED 2023-02-18 15:01:12,626 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472625"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732472625"}]},"ts":"1676732472625"} 2023-02-18 15:01:12,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=34 2023-02-18 15:01:12,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=34, state=SUCCESS; CloseRegionProcedure 0a9e49a654a25d33ce2c87eb8d60e134, server=jenkins-hbase4.apache.org,46385,1676732459629 in 180 msec 2023-02-18 15:01:12,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=41 2023-02-18 15:01:12,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=41, state=SUCCESS; CloseRegionProcedure 205bb2a0c3f98ef17e15352ea574c983, server=jenkins-hbase4.apache.org,46721,1676732459680 in 194 msec 2023-02-18 15:01:12,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0a9e49a654a25d33ce2c87eb8d60e134, UNASSIGN in 234 msec 2023-02-18 15:01:12,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=205bb2a0c3f98ef17e15352ea574c983, UNASSIGN in 235 msec 2023-02-18 15:01:12,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:12,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c. 2023-02-18 15:01:12,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7d643e504718c341f5d23797f65f832c: 2023-02-18 15:01:12,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:12,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:12,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:12,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3f21eb7f443add362b469d2c02a35430, disabling compactions & flushes 2023-02-18 15:01:12,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:12,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:12,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. after waiting 0 ms 2023-02-18 15:01:12,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:12,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90. 2023-02-18 15:01:12,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 30da3b3610442bb6d6fe624fcec2de90: 2023-02-18 15:01:12,672 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=7d643e504718c341f5d23797f65f832c, regionState=CLOSED 2023-02-18 15:01:12,673 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472672"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732472672"}]},"ts":"1676732472672"} 2023-02-18 15:01:12,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:12,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:12,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e47b3c30328aecb262c445857eab5a45, disabling compactions & flushes 2023-02-18 15:01:12,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:12,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:12,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. after waiting 0 ms 2023-02-18 15:01:12,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:12,681 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=30da3b3610442bb6d6fe624fcec2de90, regionState=CLOSED 2023-02-18 15:01:12,681 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472681"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732472681"}]},"ts":"1676732472681"} 2023-02-18 15:01:12,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=35 2023-02-18 15:01:12,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=35, state=SUCCESS; CloseRegionProcedure 7d643e504718c341f5d23797f65f832c, server=jenkins-hbase4.apache.org,46385,1676732459629 in 235 msec 2023-02-18 15:01:12,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-18 15:01:12,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 30da3b3610442bb6d6fe624fcec2de90, server=jenkins-hbase4.apache.org,46721,1676732459680 in 242 msec 2023-02-18 15:01:12,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7d643e504718c341f5d23797f65f832c, UNASSIGN in 268 msec 2023-02-18 15:01:12,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=30da3b3610442bb6d6fe624fcec2de90, UNASSIGN in 270 msec 2023-02-18 15:01:12,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:12,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430. 2023-02-18 15:01:12,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3f21eb7f443add362b469d2c02a35430: 2023-02-18 15:01:12,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:12,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45. 2023-02-18 15:01:12,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e47b3c30328aecb262c445857eab5a45: 2023-02-18 15:01:12,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:12,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:12,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bc5da7d6cfb34e088b8cc688b083d74b, disabling compactions & flushes 2023-02-18 15:01:12,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:12,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:12,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. after waiting 0 ms 2023-02-18 15:01:12,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:12,702 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3f21eb7f443add362b469d2c02a35430, regionState=CLOSED 2023-02-18 15:01:12,702 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732472702"}]},"ts":"1676732472702"} 2023-02-18 15:01:12,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:12,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:12,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 39d83cfde4a830e40ab428208c2cedd3, disabling compactions & flushes 2023-02-18 15:01:12,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:12,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:12,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. after waiting 0 ms 2023-02-18 15:01:12,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:12,703 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=e47b3c30328aecb262c445857eab5a45, regionState=CLOSED 2023-02-18 15:01:12,703 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472703"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732472703"}]},"ts":"1676732472703"} 2023-02-18 15:01:12,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=40 2023-02-18 15:01:12,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=40, state=SUCCESS; CloseRegionProcedure 3f21eb7f443add362b469d2c02a35430, server=jenkins-hbase4.apache.org,46385,1676732459629 in 272 msec 2023-02-18 15:01:12,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=39 2023-02-18 15:01:12,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=39, state=SUCCESS; CloseRegionProcedure e47b3c30328aecb262c445857eab5a45, server=jenkins-hbase4.apache.org,46721,1676732459680 in 275 msec 2023-02-18 15:01:12,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3f21eb7f443add362b469d2c02a35430, UNASSIGN in 289 msec 2023-02-18 15:01:12,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e47b3c30328aecb262c445857eab5a45, UNASSIGN in 290 msec 2023-02-18 15:01:12,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:12,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 15:01:12,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b. 2023-02-18 15:01:12,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bc5da7d6cfb34e088b8cc688b083d74b: 2023-02-18 15:01:12,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:12,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:12,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2e392bd4cb4c185ea77b956fdf9dd990, disabling compactions & flushes 2023-02-18 15:01:12,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:12,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:12,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. after waiting 0 ms 2023-02-18 15:01:12,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:12,723 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bc5da7d6cfb34e088b8cc688b083d74b, regionState=CLOSED 2023-02-18 15:01:12,723 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472723"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732472723"}]},"ts":"1676732472723"} 2023-02-18 15:01:12,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-18 15:01:12,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure bc5da7d6cfb34e088b8cc688b083d74b, server=jenkins-hbase4.apache.org,46385,1676732459629 in 282 msec 2023-02-18 15:01:12,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bc5da7d6cfb34e088b8cc688b083d74b, UNASSIGN in 308 msec 2023-02-18 15:01:12,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:12,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 15:01:12,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3. 2023-02-18 15:01:12,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 39d83cfde4a830e40ab428208c2cedd3: 2023-02-18 15:01:12,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990. 2023-02-18 15:01:12,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2e392bd4cb4c185ea77b956fdf9dd990: 2023-02-18 15:01:12,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:12,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:12,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6a6e1ad761fbe4daf556174450868f9a, disabling compactions & flushes 2023-02-18 15:01:12,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:12,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:12,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. after waiting 0 ms 2023-02-18 15:01:12,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:12,745 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=39d83cfde4a830e40ab428208c2cedd3, regionState=CLOSED 2023-02-18 15:01:12,745 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472745"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732472745"}]},"ts":"1676732472745"} 2023-02-18 15:01:12,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:12,746 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2e392bd4cb4c185ea77b956fdf9dd990, regionState=CLOSED 2023-02-18 15:01:12,746 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732472746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732472746"}]},"ts":"1676732472746"} 2023-02-18 15:01:12,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=36 2023-02-18 15:01:12,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=36, state=SUCCESS; CloseRegionProcedure 39d83cfde4a830e40ab428208c2cedd3, server=jenkins-hbase4.apache.org,46721,1676732459680 in 298 msec 2023-02-18 15:01:12,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-02-18 15:01:12,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; CloseRegionProcedure 2e392bd4cb4c185ea77b956fdf9dd990, server=jenkins-hbase4.apache.org,46385,1676732459629 in 319 msec 2023-02-18 15:01:12,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=39d83cfde4a830e40ab428208c2cedd3, UNASSIGN in 331 msec 2023-02-18 15:01:12,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2e392bd4cb4c185ea77b956fdf9dd990, UNASSIGN in 330 msec 2023-02-18 15:01:12,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:12,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a. 2023-02-18 15:01:12,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6a6e1ad761fbe4daf556174450868f9a: 2023-02-18 15:01:12,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:12,761 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=6a6e1ad761fbe4daf556174450868f9a, regionState=CLOSED 2023-02-18 15:01:12,762 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732472761"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732472761"}]},"ts":"1676732472761"} 2023-02-18 15:01:12,765 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-02-18 15:01:12,765 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; CloseRegionProcedure 6a6e1ad761fbe4daf556174450868f9a, server=jenkins-hbase4.apache.org,46721,1676732459680 in 334 msec 2023-02-18 15:01:12,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=33 2023-02-18 15:01:12,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6a6e1ad761fbe4daf556174450868f9a, UNASSIGN in 343 msec 2023-02-18 15:01:12,768 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732472768"}]},"ts":"1676732472768"} 2023-02-18 15:01:12,770 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-18 15:01:12,772 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-18 15:01:12,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 370 msec 2023-02-18 15:01:13,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 15:01:13,023 INFO [Listener at localhost/42771] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-18 15:01:13,028 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-18 15:01:13,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:13,038 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:13,040 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:13,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 15:01:13,060 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:13,060 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:13,061 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:13,061 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:13,060 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:13,060 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:13,060 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:13,061 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:13,068 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/recovered.edits] 2023-02-18 15:01:13,068 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/recovered.edits] 2023-02-18 15:01:13,069 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/recovered.edits] 2023-02-18 15:01:13,070 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/f1, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/f2, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/recovered.edits] 2023-02-18 15:01:13,070 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/recovered.edits] 2023-02-18 15:01:13,071 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/recovered.edits] 2023-02-18 15:01:13,071 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/recovered.edits] 2023-02-18 15:01:13,072 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/recovered.edits] 2023-02-18 15:01:13,085 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1/ce8fa96f302b4e7780ac23ef16b07878 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1/ce8fa96f302b4e7780ac23ef16b07878 2023-02-18 15:01:13,085 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1/0d0c35ca19cd498191e2ab71693a450f to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1/0d0c35ca19cd498191e2ab71693a450f 2023-02-18 15:01:13,086 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1/17fcee6b13f945b0b80cb0804f8a0211 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1/17fcee6b13f945b0b80cb0804f8a0211 2023-02-18 15:01:13,086 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1/9c4bfeb3101e4033b94c1343c138a5c2 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1/9c4bfeb3101e4033b94c1343c138a5c2 2023-02-18 15:01:13,086 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1/78c4b72b4fe64762a4e6edeb9b0bd05e to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1/78c4b72b4fe64762a4e6edeb9b0bd05e 2023-02-18 15:01:13,088 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/recovered.edits/6.seqid to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134/recovered.edits/6.seqid 2023-02-18 15:01:13,089 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1/2f81b6d0afae432fa62e9aae7006af12 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1/2f81b6d0afae432fa62e9aae7006af12 2023-02-18 15:01:13,089 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1/4941d03134b342988f2d4c106939d59b to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1/4941d03134b342988f2d4c106939d59b 2023-02-18 15:01:13,090 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/0a9e49a654a25d33ce2c87eb8d60e134 2023-02-18 15:01:13,090 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:13,091 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1/bb89cfa569e34c3e85270f87cd918908 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f1/bb89cfa569e34c3e85270f87cd918908 2023-02-18 15:01:13,091 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1/99f4454770fa45a795185ec47ffcf98a to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f1/99f4454770fa45a795185ec47ffcf98a 2023-02-18 15:01:13,091 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1/458a6a88c51741e0abb692dad3965479 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f1/458a6a88c51741e0abb692dad3965479 2023-02-18 15:01:13,091 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1/b009c55e1b0944ea86cec96a47534d2f to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f1/b009c55e1b0944ea86cec96a47534d2f 2023-02-18 15:01:13,092 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1/e183eaf4ccb04554a9987e6895d8e412 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f1/e183eaf4ccb04554a9987e6895d8e412 2023-02-18 15:01:13,094 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1/61bf64811eb240b6a01429c4acd5d083 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f1/61bf64811eb240b6a01429c4acd5d083 2023-02-18 15:01:13,095 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1/94632aa0690e4107aa37e0385115b5a2 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f1/94632aa0690e4107aa37e0385115b5a2 2023-02-18 15:01:13,099 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/recovered.edits] 2023-02-18 15:01:13,102 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2/1c85c3f1479643aeaa0048d27054bc27 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2/1c85c3f1479643aeaa0048d27054bc27 2023-02-18 15:01:13,103 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2/aef2d691a5944ae7bdeeb5133e28e896 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2/aef2d691a5944ae7bdeeb5133e28e896 2023-02-18 15:01:13,104 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2/07d133cb500949f6b803955ff9730fff to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2/07d133cb500949f6b803955ff9730fff 2023-02-18 15:01:13,104 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2/8ded650abc0b4f84877abe83dd95663d to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2/8ded650abc0b4f84877abe83dd95663d 2023-02-18 15:01:13,105 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2/081f5da0da4847e5bbae30f205a54c4c to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2/081f5da0da4847e5bbae30f205a54c4c 2023-02-18 15:01:13,105 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2/3811bb0615034bef8bc4d720562c44c5 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2/3811bb0615034bef8bc4d720562c44c5 2023-02-18 15:01:13,106 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2/7b35c94284c045d2aad68f8a3e3461f9 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2/7b35c94284c045d2aad68f8a3e3461f9 2023-02-18 15:01:13,108 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2/447feae449bb41af89ec325f7179dd66 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/f2/447feae449bb41af89ec325f7179dd66 2023-02-18 15:01:13,108 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2/b1351bb77d3342ec8517114e07e66beb to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/f2/b1351bb77d3342ec8517114e07e66beb 2023-02-18 15:01:13,109 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2/e876d671995b45f890207094b418f0fa to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/f2/e876d671995b45f890207094b418f0fa 2023-02-18 15:01:13,110 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2/e84274a674234784a17c7fe62cdaf813 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/f2/e84274a674234784a17c7fe62cdaf813 2023-02-18 15:01:13,111 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2/b79cac028cb748f5a77aa60c010e435c to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/f2/b79cac028cb748f5a77aa60c010e435c 2023-02-18 15:01:13,112 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2/bd74383fa1224f00a2615600fb43e1f1 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/f2/bd74383fa1224f00a2615600fb43e1f1 2023-02-18 15:01:13,112 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2/a6c561242dde499db123c5339bbaf54a to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/f2/a6c561242dde499db123c5339bbaf54a 2023-02-18 15:01:13,112 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1/938dbe1dee8c4c20847fe98b5c0260a3 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1/938dbe1dee8c4c20847fe98b5c0260a3 2023-02-18 15:01:13,116 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1/9e9c171d09ab44fbac4dd218b4ec9e62 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f1/9e9c171d09ab44fbac4dd218b4ec9e62 2023-02-18 15:01:13,118 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/recovered.edits/12.seqid to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90/recovered.edits/12.seqid 2023-02-18 15:01:13,119 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/recovered.edits/12.seqid to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3/recovered.edits/12.seqid 2023-02-18 15:01:13,120 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/recovered.edits/12.seqid to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430/recovered.edits/12.seqid 2023-02-18 15:01:13,120 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/30da3b3610442bb6d6fe624fcec2de90 2023-02-18 15:01:13,120 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:13,124 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/f1, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/f2, FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/recovered.edits] 2023-02-18 15:01:13,124 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/39d83cfde4a830e40ab428208c2cedd3 2023-02-18 15:01:13,124 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/recovered.edits/12.seqid to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45/recovered.edits/12.seqid 2023-02-18 15:01:13,125 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/3f21eb7f443add362b469d2c02a35430 2023-02-18 15:01:13,126 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/recovered.edits/12.seqid to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c/recovered.edits/12.seqid 2023-02-18 15:01:13,130 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/recovered.edits/12.seqid to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983/recovered.edits/12.seqid 2023-02-18 15:01:13,130 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/recovered.edits/12.seqid to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b/recovered.edits/12.seqid 2023-02-18 15:01:13,130 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/e47b3c30328aecb262c445857eab5a45 2023-02-18 15:01:13,131 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/7d643e504718c341f5d23797f65f832c 2023-02-18 15:01:13,131 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/205bb2a0c3f98ef17e15352ea574c983 2023-02-18 15:01:13,132 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/bc5da7d6cfb34e088b8cc688b083d74b 2023-02-18 15:01:13,132 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2/1f581c3952b54bae9cba0185c1acb596 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2/1f581c3952b54bae9cba0185c1acb596 2023-02-18 15:01:13,134 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2/9edc38d46d85499bb491b427eb8877b0 to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/f2/9edc38d46d85499bb491b427eb8877b0 2023-02-18 15:01:13,137 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/recovered.edits/6.seqid to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990/recovered.edits/6.seqid 2023-02-18 15:01:13,139 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/2e392bd4cb4c185ea77b956fdf9dd990 2023-02-18 15:01:13,139 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/recovered.edits/12.seqid to hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/archive/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a/recovered.edits/12.seqid 2023-02-18 15:01:13,140 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/.tmp/data/default/testWithMapReduce/6a6e1ad761fbe4daf556174450868f9a 2023-02-18 15:01:13,140 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 15:01:13,143 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:13,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 15:01:13,168 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-18 15:01:13,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-18 15:01:13,176 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:13,176 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-18 15:01:13,177 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732473176"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:13,177 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732473176"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:13,177 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732473176"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:13,177 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732473176"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:13,177 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732473176"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:13,177 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732473176"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:13,177 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732473176"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:13,177 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732473176"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:13,178 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732473176"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:13,178 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732473176"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:13,182 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-18 15:01:13,182 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0a9e49a654a25d33ce2c87eb8d60e134, NAME => 'testWithMapReduce,,1676732462592.0a9e49a654a25d33ce2c87eb8d60e134.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 7d643e504718c341f5d23797f65f832c, NAME => 'testWithMapReduce,aaa,1676732462592.7d643e504718c341f5d23797f65f832c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 39d83cfde4a830e40ab428208c2cedd3, NAME => 'testWithMapReduce,d\x84\x84,1676732462592.39d83cfde4a830e40ab428208c2cedd3.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 30da3b3610442bb6d6fe624fcec2de90, NAME => 'testWithMapReduce,g\xA7\xA7,1676732462592.30da3b3610442bb6d6fe624fcec2de90.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => bc5da7d6cfb34e088b8cc688b083d74b, NAME => 'testWithMapReduce,j\xCA\xCA,1676732462592.bc5da7d6cfb34e088b8cc688b083d74b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => e47b3c30328aecb262c445857eab5a45, NAME => 'testWithMapReduce,m\xED\xED,1676732462592.e47b3c30328aecb262c445857eab5a45.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 3f21eb7f443add362b469d2c02a35430, NAME => 'testWithMapReduce,q\x11\x10,1676732462592.3f21eb7f443add362b469d2c02a35430.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 205bb2a0c3f98ef17e15352ea574c983, NAME => 'testWithMapReduce,t43,1676732462592.205bb2a0c3f98ef17e15352ea574c983.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 6a6e1ad761fbe4daf556174450868f9a, NAME => 'testWithMapReduce,wWV,1676732462592.6a6e1ad761fbe4daf556174450868f9a.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 2e392bd4cb4c185ea77b956fdf9dd990, NAME => 'testWithMapReduce,zz{,1676732462592.2e392bd4cb4c185ea77b956fdf9dd990.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-18 15:01:13,183 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-18 15:01:13,183 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676732473183"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:13,185 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-18 15:01:13,187 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:13,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 158 msec 2023-02-18 15:01:13,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39419] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 15:01:13,346 INFO [Listener at localhost/42771] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-18 15:01:13,346 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 15:01:13,346 INFO [Listener at localhost/42771] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 15:01:13,346 DEBUG [Listener at localhost/42771] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1643fa82 to 127.0.0.1:63142 2023-02-18 15:01:13,346 DEBUG [Listener at localhost/42771] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:13,346 DEBUG [Listener at localhost/42771] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 15:01:13,346 DEBUG [Listener at localhost/42771] util.JVMClusterUtil(257): Found active master hash=1969539197, stopped=false 2023-02-18 15:01:13,347 INFO [Listener at localhost/42771] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39419,1676732458422 2023-02-18 15:01:13,350 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:13,350 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:13,350 INFO [Listener at localhost/42771] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 15:01:13,350 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:13,350 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:13,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:13,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:13,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:13,353 DEBUG [Listener at localhost/42771] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7247152e to 127.0.0.1:63142 2023-02-18 15:01:13,353 DEBUG [Listener at localhost/42771] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:13,353 INFO [Listener at localhost/42771] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46385,1676732459629' ***** 2023-02-18 15:01:13,353 INFO [Listener at localhost/42771] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:13,353 INFO [Listener at localhost/42771] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46721,1676732459680' ***** 2023-02-18 15:01:13,353 INFO [Listener at localhost/42771] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:13,354 INFO [RS:1;jenkins-hbase4:46721] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:13,354 INFO [RS:0;jenkins-hbase4:46385] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:13,354 INFO [RS:1;jenkins-hbase4:46721] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:13,354 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:13,354 INFO [RS:1;jenkins-hbase4:46721] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:13,354 INFO [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(3304): Received CLOSE for 8df8d0445c3895bf8f636e81111e36c7 2023-02-18 15:01:13,354 INFO [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:13,355 DEBUG [RS:1;jenkins-hbase4:46721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13d61333 to 127.0.0.1:63142 2023-02-18 15:01:13,355 DEBUG [RS:1;jenkins-hbase4:46721] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:13,355 INFO [RS:1;jenkins-hbase4:46721] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:13,355 INFO [RS:1;jenkins-hbase4:46721] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:13,355 INFO [RS:1;jenkins-hbase4:46721] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:13,355 INFO [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 15:01:13,355 INFO [RS:0;jenkins-hbase4:46385] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:13,355 INFO [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-18 15:01:13,355 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:13,355 DEBUG [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 8df8d0445c3895bf8f636e81111e36c7=hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7.} 2023-02-18 15:01:13,355 INFO [RS:0;jenkins-hbase4:46385] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:13,355 INFO [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:13,355 DEBUG [RS:0;jenkins-hbase4:46385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x012c8b98 to 127.0.0.1:63142 2023-02-18 15:01:13,355 DEBUG [RS:0;jenkins-hbase4:46385] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:13,356 INFO [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46385,1676732459629; all regions closed. 2023-02-18 15:01:13,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8df8d0445c3895bf8f636e81111e36c7, disabling compactions & flushes 2023-02-18 15:01:13,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:13,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:13,357 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:13,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:13,357 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:13,357 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:13,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. after waiting 0 ms 2023-02-18 15:01:13,357 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:13,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:13,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 8df8d0445c3895bf8f636e81111e36c7 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 15:01:13,357 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-18 15:01:13,359 DEBUG [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1505): Waiting on 1588230740, 8df8d0445c3895bf8f636e81111e36c7 2023-02-18 15:01:13,368 DEBUG [RS:0;jenkins-hbase4:46385] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/oldWALs 2023-02-18 15:01:13,368 INFO [RS:0;jenkins-hbase4:46385] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46385%2C1676732459629:(num 1676732462091) 2023-02-18 15:01:13,368 DEBUG [RS:0;jenkins-hbase4:46385] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:13,368 INFO [RS:0;jenkins-hbase4:46385] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:13,368 INFO [RS:0;jenkins-hbase4:46385] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:13,369 INFO [RS:0;jenkins-hbase4:46385] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:13,369 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:13,369 INFO [RS:0;jenkins-hbase4:46385] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:13,369 INFO [RS:0;jenkins-hbase4:46385] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:13,371 INFO [RS:0;jenkins-hbase4:46385] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46385 2023-02-18 15:01:13,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7/.tmp/info/d1e2bc2e7e274519a5958cb73aad6f58 2023-02-18 15:01:13,399 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:13,399 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:13,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7/.tmp/info/d1e2bc2e7e274519a5958cb73aad6f58 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7/info/d1e2bc2e7e274519a5958cb73aad6f58 2023-02-18 15:01:13,414 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/.tmp/info/c4eaf936615d40a6a161a032377a3bb3 2023-02-18 15:01:13,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7/info/d1e2bc2e7e274519a5958cb73aad6f58, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 15:01:13,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8df8d0445c3895bf8f636e81111e36c7 in 62ms, sequenceid=6, compaction requested=false 2023-02-18 15:01:13,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4eaf936615d40a6a161a032377a3bb3 2023-02-18 15:01:13,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/namespace/8df8d0445c3895bf8f636e81111e36c7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 15:01:13,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:13,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8df8d0445c3895bf8f636e81111e36c7: 2023-02-18 15:01:13,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676732461682.8df8d0445c3895bf8f636e81111e36c7. 2023-02-18 15:01:13,453 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/.tmp/rep_barrier/ea9a43278e6e4eda839e6be5c5b2a44f 2023-02-18 15:01:13,459 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:13,459 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:13,459 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46385,1676732459629 2023-02-18 15:01:13,460 ERROR [Listener at localhost/42771-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14a1fd3c rejected from java.util.concurrent.ThreadPoolExecutor@109e6b70[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:13,460 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:13,460 ERROR [Listener at localhost/42771-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7fd08bb4 rejected from java.util.concurrent.ThreadPoolExecutor@109e6b70[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:13,459 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:13,460 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea9a43278e6e4eda839e6be5c5b2a44f 2023-02-18 15:01:13,461 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46385,1676732459629] 2023-02-18 15:01:13,461 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46385,1676732459629; numProcessing=1 2023-02-18 15:01:13,462 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46385,1676732459629 already deleted, retry=false 2023-02-18 15:01:13,462 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46385,1676732459629 expired; onlineServers=1 2023-02-18 15:01:13,474 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/.tmp/table/3233585c13a04345a551f02f9406741f 2023-02-18 15:01:13,479 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3233585c13a04345a551f02f9406741f 2023-02-18 15:01:13,480 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/.tmp/info/c4eaf936615d40a6a161a032377a3bb3 as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/info/c4eaf936615d40a6a161a032377a3bb3 2023-02-18 15:01:13,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4eaf936615d40a6a161a032377a3bb3 2023-02-18 15:01:13,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/info/c4eaf936615d40a6a161a032377a3bb3, entries=30, sequenceid=57, filesize=7.9 K 2023-02-18 15:01:13,488 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/.tmp/rep_barrier/ea9a43278e6e4eda839e6be5c5b2a44f as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/rep_barrier/ea9a43278e6e4eda839e6be5c5b2a44f 2023-02-18 15:01:13,494 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea9a43278e6e4eda839e6be5c5b2a44f 2023-02-18 15:01:13,494 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/rep_barrier/ea9a43278e6e4eda839e6be5c5b2a44f, entries=10, sequenceid=57, filesize=5.9 K 2023-02-18 15:01:13,495 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/.tmp/table/3233585c13a04345a551f02f9406741f as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/table/3233585c13a04345a551f02f9406741f 2023-02-18 15:01:13,504 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3233585c13a04345a551f02f9406741f 2023-02-18 15:01:13,504 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/table/3233585c13a04345a551f02f9406741f, entries=13, sequenceid=57, filesize=5.9 K 2023-02-18 15:01:13,508 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 151ms, sequenceid=57, compaction requested=false 2023-02-18 15:01:13,518 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-18 15:01:13,519 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 15:01:13,520 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:13,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:13,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:13,559 INFO [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46721,1676732459680; all regions closed. 2023-02-18 15:01:13,567 DEBUG [RS:1;jenkins-hbase4:46721] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/oldWALs 2023-02-18 15:01:13,567 INFO [RS:1;jenkins-hbase4:46721] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46721%2C1676732459680.meta:.meta(num 1676732461408) 2023-02-18 15:01:13,572 DEBUG [RS:1;jenkins-hbase4:46721] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/oldWALs 2023-02-18 15:01:13,572 INFO [RS:1;jenkins-hbase4:46721] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46721%2C1676732459680:(num 1676732462091) 2023-02-18 15:01:13,572 DEBUG [RS:1;jenkins-hbase4:46721] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:13,572 INFO [RS:1;jenkins-hbase4:46721] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:13,573 INFO [RS:1;jenkins-hbase4:46721] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:13,573 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:13,574 INFO [RS:1;jenkins-hbase4:46721] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46721 2023-02-18 15:01:13,578 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:13,578 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46721,1676732459680 2023-02-18 15:01:13,579 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46721,1676732459680] 2023-02-18 15:01:13,579 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46721,1676732459680; numProcessing=2 2023-02-18 15:01:13,580 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46721,1676732459680 already deleted, retry=false 2023-02-18 15:01:13,580 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46721,1676732459680 expired; onlineServers=0 2023-02-18 15:01:13,580 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39419,1676732458422' ***** 2023-02-18 15:01:13,580 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 15:01:13,581 DEBUG [M:0;jenkins-hbase4:39419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3459c246, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:13,581 INFO [M:0;jenkins-hbase4:39419] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39419,1676732458422 2023-02-18 15:01:13,581 INFO [M:0;jenkins-hbase4:39419] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39419,1676732458422; all regions closed. 2023-02-18 15:01:13,581 DEBUG [M:0;jenkins-hbase4:39419] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:13,581 DEBUG [M:0;jenkins-hbase4:39419] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 15:01:13,581 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 15:01:13,581 DEBUG [M:0;jenkins-hbase4:39419] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 15:01:13,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732460874] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732460874,5,FailOnTimeoutGroup] 2023-02-18 15:01:13,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732460873] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732460873,5,FailOnTimeoutGroup] 2023-02-18 15:01:13,584 INFO [M:0;jenkins-hbase4:39419] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 15:01:13,584 INFO [M:0;jenkins-hbase4:39419] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 15:01:13,584 INFO [M:0;jenkins-hbase4:39419] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 15:01:13,584 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:13,584 DEBUG [M:0;jenkins-hbase4:39419] master.HMaster(1512): Stopping service threads 2023-02-18 15:01:13,584 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:13,585 INFO [M:0;jenkins-hbase4:39419] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 15:01:13,585 ERROR [M:0;jenkins-hbase4:39419] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] 2023-02-18 15:01:13,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-18 15:01:13,586 INFO [M:0;jenkins-hbase4:39419] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 15:01:13,586 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 15:01:13,586 DEBUG [M:0;jenkins-hbase4:39419] zookeeper.ZKUtil(398): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 15:01:13,587 WARN [M:0;jenkins-hbase4:39419] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 15:01:13,587 INFO [M:0;jenkins-hbase4:39419] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 15:01:13,587 INFO [M:0;jenkins-hbase4:39419] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 15:01:13,588 DEBUG [M:0;jenkins-hbase4:39419] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:13,588 INFO [M:0;jenkins-hbase4:39419] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:13,588 DEBUG [M:0;jenkins-hbase4:39419] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:13,588 DEBUG [M:0;jenkins-hbase4:39419] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:13,588 DEBUG [M:0;jenkins-hbase4:39419] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:13,588 INFO [M:0;jenkins-hbase4:39419] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.26 KB heapSize=192.19 KB 2023-02-18 15:01:13,606 INFO [M:0;jenkins-hbase4:39419] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.26 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8dbadbe847ad4696aa801b335688c8cd 2023-02-18 15:01:13,613 DEBUG [M:0;jenkins-hbase4:39419] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8dbadbe847ad4696aa801b335688c8cd as hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8dbadbe847ad4696aa801b335688c8cd 2023-02-18 15:01:13,626 INFO [M:0;jenkins-hbase4:39419] regionserver.HStore(1080): Added hdfs://localhost:37253/user/jenkins/test-data/675a6ad8-4290-de21-c9b2-7a9910a2abb3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8dbadbe847ad4696aa801b335688c8cd, entries=53, sequenceid=357, filesize=10.4 K 2023-02-18 15:01:13,627 INFO [M:0;jenkins-hbase4:39419] regionserver.HRegion(2947): Finished flush of dataSize ~159.26 KB/163083, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 39ms, sequenceid=357, compaction requested=false 2023-02-18 15:01:13,633 INFO [M:0;jenkins-hbase4:39419] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:13,633 DEBUG [M:0;jenkins-hbase4:39419] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:13,637 INFO [M:0;jenkins-hbase4:39419] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 15:01:13,637 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:13,638 INFO [M:0;jenkins-hbase4:39419] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39419 2023-02-18 15:01:13,642 DEBUG [M:0;jenkins-hbase4:39419] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39419,1676732458422 already deleted, retry=false 2023-02-18 15:01:13,662 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:13,662 INFO [RS:0;jenkins-hbase4:46385] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46385,1676732459629; zookeeper connection closed. 2023-02-18 15:01:13,662 ERROR [Listener at localhost/42771-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a5e374 rejected from java.util.concurrent.ThreadPoolExecutor@109e6b70[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:13,662 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46385-0x10067f2cc040001, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:13,662 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@70d5276b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@70d5276b 2023-02-18 15:01:13,662 ERROR [Listener at localhost/42771-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e45a861 rejected from java.util.concurrent.ThreadPoolExecutor@109e6b70[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:13,863 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:13,863 INFO [M:0;jenkins-hbase4:39419] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39419,1676732458422; zookeeper connection closed. 2023-02-18 15:01:13,863 ERROR [Listener at localhost/42771-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@647265d6 rejected from java.util.concurrent.ThreadPoolExecutor@987471d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:13,863 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): master:39419-0x10067f2cc040000, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:13,863 ERROR [Listener at localhost/42771-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56a45812 rejected from java.util.concurrent.ThreadPoolExecutor@987471d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:13,963 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:13,963 INFO [RS:1;jenkins-hbase4:46721] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46721,1676732459680; zookeeper connection closed. 2023-02-18 15:01:13,963 ERROR [Listener at localhost/42771-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40d2b696 rejected from java.util.concurrent.ThreadPoolExecutor@44ed3a54[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:13,963 DEBUG [Listener at localhost/42771-EventThread] zookeeper.ZKWatcher(600): regionserver:46721-0x10067f2cc040002, quorum=127.0.0.1:63142, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:13,963 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4e4461f2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4e4461f2 2023-02-18 15:01:13,964 ERROR [Listener at localhost/42771-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@651751c5 rejected from java.util.concurrent.ThreadPoolExecutor@44ed3a54[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:13,964 INFO [Listener at localhost/42771] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 15:01:13,965 WARN [Listener at localhost/42771] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:13,970 INFO [Listener at localhost/42771] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:14,074 WARN [BP-1224335318-172.31.14.131-1676732454695 heartbeating to localhost/127.0.0.1:37253] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:14,074 WARN [BP-1224335318-172.31.14.131-1676732454695 heartbeating to localhost/127.0.0.1:37253] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1224335318-172.31.14.131-1676732454695 (Datanode Uuid 5a61b471-68da-497b-ab77-217fd70cf129) service to localhost/127.0.0.1:37253 2023-02-18 15:01:14,076 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/cluster_9c5c8fe6-0cae-5d31-f576-c14feeac25e8/dfs/data/data3/current/BP-1224335318-172.31.14.131-1676732454695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:14,076 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/cluster_9c5c8fe6-0cae-5d31-f576-c14feeac25e8/dfs/data/data4/current/BP-1224335318-172.31.14.131-1676732454695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:14,078 WARN [Listener at localhost/42771] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:14,081 INFO [Listener at localhost/42771] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:14,185 WARN [BP-1224335318-172.31.14.131-1676732454695 heartbeating to localhost/127.0.0.1:37253] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:14,185 WARN [BP-1224335318-172.31.14.131-1676732454695 heartbeating to localhost/127.0.0.1:37253] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1224335318-172.31.14.131-1676732454695 (Datanode Uuid 53275d4e-8370-4ffa-97bf-e416c2fef931) service to localhost/127.0.0.1:37253 2023-02-18 15:01:14,186 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/cluster_9c5c8fe6-0cae-5d31-f576-c14feeac25e8/dfs/data/data1/current/BP-1224335318-172.31.14.131-1676732454695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:14,186 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/cluster_9c5c8fe6-0cae-5d31-f576-c14feeac25e8/dfs/data/data2/current/BP-1224335318-172.31.14.131-1676732454695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:14,223 INFO [Listener at localhost/42771] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:14,344 INFO [Listener at localhost/42771] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 15:01:14,407 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 15:01:14,421 INFO [Listener at localhost/42771] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=100 (was 7) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:37253 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@227c24ec java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:37253 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:37253 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39419,1676732458422)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37253 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:37253 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:37253 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42771 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:37253 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=543 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=315 (was 237) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=9477 (was 11011) 2023-02-18 15:01:14,429 INFO [Listener at localhost/42771] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=100, OpenFileDescriptor=543, MaxFileDescriptor=60000, SystemLoadAverage=315, ProcessCount=171, AvailableMemoryMB=9477 2023-02-18 15:01:14,440 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/hadoop.log.dir so I do NOT create it in target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f 2023-02-18 15:01:14,440 WARN [Listener at localhost/42771] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 15:01:14,440 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/hadoop.tmp.dir so I do NOT create it in target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f 2023-02-18 15:01:14,440 WARN [Listener at localhost/42771] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d7cea9e-96fe-4c30-d15f-e9bbffc22319/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 15:01:14,440 DEBUG [Listener at localhost/42771] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f 2023-02-18 15:01:14,441 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 15:01:14,441 INFO [Listener at localhost/42771] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/cluster_d0177970-bd8a-78ef-df77-67fe80ff0e0d, deleteOnExit=true 2023-02-18 15:01:14,441 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 15:01:14,441 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/test.cache.data in system properties and HBase conf 2023-02-18 15:01:14,441 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 15:01:14,441 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/hadoop.log.dir in system properties and HBase conf 2023-02-18 15:01:14,441 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 15:01:14,441 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 15:01:14,441 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 15:01:14,441 DEBUG [Listener at localhost/42771] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 15:01:14,442 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:14,442 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:14,442 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 15:01:14,442 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:14,442 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 15:01:14,442 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 15:01:14,442 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:14,442 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:14,443 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 15:01:14,443 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/nfs.dump.dir in system properties and HBase conf 2023-02-18 15:01:14,443 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/java.io.tmpdir in system properties and HBase conf 2023-02-18 15:01:14,443 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:14,443 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 15:01:14,443 INFO [Listener at localhost/42771] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 15:01:14,447 WARN [Listener at localhost/42771] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:14,447 WARN [Listener at localhost/42771] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:14,492 WARN [Listener at localhost/42771] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:14,494 INFO [Listener at localhost/42771] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:14,500 INFO [Listener at localhost/42771] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/java.io.tmpdir/Jetty_localhost_44621_hdfs____.jjo2ch/webapp 2023-02-18 15:01:14,603 INFO [Listener at localhost/42771] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44621 2023-02-18 15:01:14,607 WARN [Listener at localhost/42771] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:14,607 WARN [Listener at localhost/42771] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:14,652 WARN [Listener at localhost/32933] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:14,666 WARN [Listener at localhost/32933] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:14,669 WARN [Listener at localhost/32933] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:14,670 INFO [Listener at localhost/32933] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:14,682 INFO [Listener at localhost/32933] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/java.io.tmpdir/Jetty_localhost_35179_datanode____dc5h94/webapp 2023-02-18 15:01:14,787 INFO [Listener at localhost/32933] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35179 2023-02-18 15:01:14,795 WARN [Listener at localhost/41719] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:14,815 WARN [Listener at localhost/41719] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:14,823 WARN [Listener at localhost/41719] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:14,824 INFO [Listener at localhost/41719] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:14,831 INFO [Listener at localhost/41719] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/java.io.tmpdir/Jetty_localhost_44423_datanode____.n7qld0/webapp 2023-02-18 15:01:14,918 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x62df058972c7163: Processing first storage report for DS-442adfec-2324-4fc5-9505-5be5bbc18a5c from datanode 3564bd55-c01e-466e-9eec-2dd18c8c9f58 2023-02-18 15:01:14,918 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x62df058972c7163: from storage DS-442adfec-2324-4fc5-9505-5be5bbc18a5c node DatanodeRegistration(127.0.0.1:35095, datanodeUuid=3564bd55-c01e-466e-9eec-2dd18c8c9f58, infoPort=37983, infoSecurePort=0, ipcPort=41719, storageInfo=lv=-57;cid=testClusterID;nsid=841087508;c=1676732474450), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:14,919 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x62df058972c7163: Processing first storage report for DS-8ecb54c2-0cda-49d7-8b19-2e09f96e6e36 from datanode 3564bd55-c01e-466e-9eec-2dd18c8c9f58 2023-02-18 15:01:14,919 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x62df058972c7163: from storage DS-8ecb54c2-0cda-49d7-8b19-2e09f96e6e36 node DatanodeRegistration(127.0.0.1:35095, datanodeUuid=3564bd55-c01e-466e-9eec-2dd18c8c9f58, infoPort=37983, infoSecurePort=0, ipcPort=41719, storageInfo=lv=-57;cid=testClusterID;nsid=841087508;c=1676732474450), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:14,940 INFO [Listener at localhost/41719] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44423 2023-02-18 15:01:14,948 WARN [Listener at localhost/46609] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:15,043 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf42f1f63638b926b: Processing first storage report for DS-60e9e744-a36c-4570-9f6d-d5f34e994f7f from datanode fd1d6afb-cc55-4361-8d74-cf9f15e275eb 2023-02-18 15:01:15,043 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf42f1f63638b926b: from storage DS-60e9e744-a36c-4570-9f6d-d5f34e994f7f node DatanodeRegistration(127.0.0.1:41735, datanodeUuid=fd1d6afb-cc55-4361-8d74-cf9f15e275eb, infoPort=35237, infoSecurePort=0, ipcPort=46609, storageInfo=lv=-57;cid=testClusterID;nsid=841087508;c=1676732474450), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:15,043 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf42f1f63638b926b: Processing first storage report for DS-4964255e-d5f3-4706-a1e1-f3d46753cb1f from datanode fd1d6afb-cc55-4361-8d74-cf9f15e275eb 2023-02-18 15:01:15,043 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf42f1f63638b926b: from storage DS-4964255e-d5f3-4706-a1e1-f3d46753cb1f node DatanodeRegistration(127.0.0.1:41735, datanodeUuid=fd1d6afb-cc55-4361-8d74-cf9f15e275eb, infoPort=35237, infoSecurePort=0, ipcPort=46609, storageInfo=lv=-57;cid=testClusterID;nsid=841087508;c=1676732474450), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:15,059 DEBUG [Listener at localhost/46609] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f 2023-02-18 15:01:15,064 INFO [Listener at localhost/46609] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/cluster_d0177970-bd8a-78ef-df77-67fe80ff0e0d/zookeeper_0, clientPort=59779, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/cluster_d0177970-bd8a-78ef-df77-67fe80ff0e0d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/cluster_d0177970-bd8a-78ef-df77-67fe80ff0e0d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 15:01:15,066 INFO [Listener at localhost/46609] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59779 2023-02-18 15:01:15,066 INFO [Listener at localhost/46609] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:15,068 INFO [Listener at localhost/46609] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:15,091 INFO [Listener at localhost/46609] util.FSUtils(479): Created version file at hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa with version=8 2023-02-18 15:01:15,092 INFO [Listener at localhost/46609] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:15,093 INFO [Listener at localhost/46609] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:15,095 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/hbase-staging 2023-02-18 15:01:15,098 INFO [Listener at localhost/46609] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:15,098 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:15,098 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:15,098 INFO [Listener at localhost/46609] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:15,098 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:15,098 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:15,098 INFO [Listener at localhost/46609] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:15,102 INFO [Listener at localhost/46609] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39403 2023-02-18 15:01:15,103 INFO [Listener at localhost/46609] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:15,104 INFO [Listener at localhost/46609] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:15,105 INFO [Listener at localhost/46609] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39403 connecting to ZooKeeper ensemble=127.0.0.1:59779 2023-02-18 15:01:15,118 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:394030x0, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:15,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39403-0x10067f3107c0000 connected 2023-02-18 15:01:15,140 DEBUG [Listener at localhost/46609] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:15,140 DEBUG [Listener at localhost/46609] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:15,141 DEBUG [Listener at localhost/46609] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:15,143 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39403 2023-02-18 15:01:15,144 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39403 2023-02-18 15:01:15,148 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39403 2023-02-18 15:01:15,148 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39403 2023-02-18 15:01:15,149 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39403 2023-02-18 15:01:15,149 INFO [Listener at localhost/46609] master.HMaster(444): hbase.rootdir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa, hbase.cluster.distributed=false 2023-02-18 15:01:15,162 INFO [Listener at localhost/46609] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:15,163 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:15,163 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:15,163 INFO [Listener at localhost/46609] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:15,163 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:15,163 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:15,163 INFO [Listener at localhost/46609] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:15,165 INFO [Listener at localhost/46609] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37135 2023-02-18 15:01:15,165 INFO [Listener at localhost/46609] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:15,169 DEBUG [Listener at localhost/46609] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:15,169 INFO [Listener at localhost/46609] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:15,170 INFO [Listener at localhost/46609] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:15,171 INFO [Listener at localhost/46609] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37135 connecting to ZooKeeper ensemble=127.0.0.1:59779 2023-02-18 15:01:15,174 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:371350x0, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:15,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37135-0x10067f3107c0001 connected 2023-02-18 15:01:15,176 DEBUG [Listener at localhost/46609] zookeeper.ZKUtil(164): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:15,176 DEBUG [Listener at localhost/46609] zookeeper.ZKUtil(164): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:15,177 DEBUG [Listener at localhost/46609] zookeeper.ZKUtil(164): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:15,180 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37135 2023-02-18 15:01:15,183 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37135 2023-02-18 15:01:15,184 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37135 2023-02-18 15:01:15,184 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37135 2023-02-18 15:01:15,184 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37135 2023-02-18 15:01:15,196 INFO [Listener at localhost/46609] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:15,197 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:15,197 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:15,197 INFO [Listener at localhost/46609] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:15,197 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:15,197 INFO [Listener at localhost/46609] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:15,197 INFO [Listener at localhost/46609] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:15,199 INFO [Listener at localhost/46609] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42421 2023-02-18 15:01:15,199 INFO [Listener at localhost/46609] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:15,200 DEBUG [Listener at localhost/46609] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:15,200 INFO [Listener at localhost/46609] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:15,201 INFO [Listener at localhost/46609] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:15,202 INFO [Listener at localhost/46609] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42421 connecting to ZooKeeper ensemble=127.0.0.1:59779 2023-02-18 15:01:15,206 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:424210x0, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:15,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42421-0x10067f3107c0002 connected 2023-02-18 15:01:15,208 DEBUG [Listener at localhost/46609] zookeeper.ZKUtil(164): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:15,208 DEBUG [Listener at localhost/46609] zookeeper.ZKUtil(164): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:15,209 DEBUG [Listener at localhost/46609] zookeeper.ZKUtil(164): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:15,212 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42421 2023-02-18 15:01:15,213 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42421 2023-02-18 15:01:15,213 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42421 2023-02-18 15:01:15,216 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42421 2023-02-18 15:01:15,217 DEBUG [Listener at localhost/46609] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42421 2023-02-18 15:01:15,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39403,1676732475097 2023-02-18 15:01:15,220 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:15,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39403,1676732475097 2023-02-18 15:01:15,222 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:15,222 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:15,222 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:15,223 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:15,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:15,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39403,1676732475097 from backup master directory 2023-02-18 15:01:15,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:15,225 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39403,1676732475097 2023-02-18 15:01:15,225 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:15,225 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:15,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39403,1676732475097 2023-02-18 15:01:15,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/hbase.id with ID: 4f3f06e6-3f69-4c10-ae3a-07921d24576b 2023-02-18 15:01:15,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:15,265 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:15,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x060f8785 to 127.0.0.1:59779 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:15,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28ce15cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:15,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:15,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 15:01:15,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:15,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/data/master/store-tmp 2023-02-18 15:01:15,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:15,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:15,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:15,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:15,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:15,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:15,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:15,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:15,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/WALs/jenkins-hbase4.apache.org,39403,1676732475097 2023-02-18 15:01:15,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39403%2C1676732475097, suffix=, logDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/WALs/jenkins-hbase4.apache.org,39403,1676732475097, archiveDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/oldWALs, maxLogs=10 2023-02-18 15:01:15,350 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41735,DS-60e9e744-a36c-4570-9f6d-d5f34e994f7f,DISK] 2023-02-18 15:01:15,369 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35095,DS-442adfec-2324-4fc5-9505-5be5bbc18a5c,DISK] 2023-02-18 15:01:15,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/WALs/jenkins-hbase4.apache.org,39403,1676732475097/jenkins-hbase4.apache.org%2C39403%2C1676732475097.1676732475312 2023-02-18 15:01:15,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41735,DS-60e9e744-a36c-4570-9f6d-d5f34e994f7f,DISK], DatanodeInfoWithStorage[127.0.0.1:35095,DS-442adfec-2324-4fc5-9505-5be5bbc18a5c,DISK]] 2023-02-18 15:01:15,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:15,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:15,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:15,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:15,382 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:15,383 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 15:01:15,384 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 15:01:15,384 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:15,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:15,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:15,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:15,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:15,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73644285, jitterRate=0.09738536179065704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:15,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:15,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 15:01:15,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 15:01:15,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 15:01:15,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 15:01:15,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 15:01:15,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 15:01:15,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 15:01:15,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 15:01:15,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 15:01:15,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 15:01:15,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 15:01:15,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 15:01:15,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 15:01:15,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 15:01:15,412 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:15,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 15:01:15,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 15:01:15,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 15:01:15,415 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:15,415 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:15,415 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:15,415 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:15,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39403,1676732475097, sessionid=0x10067f3107c0000, setting cluster-up flag (Was=false) 2023-02-18 15:01:15,423 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:15,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 15:01:15,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39403,1676732475097 2023-02-18 15:01:15,432 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:15,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 15:01:15,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39403,1676732475097 2023-02-18 15:01:15,438 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.hbase-snapshot/.tmp 2023-02-18 15:01:15,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:15,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:15,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:15,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:15,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:15,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 15:01:15,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:15,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676732505444 2023-02-18 15:01:15,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 15:01:15,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 15:01:15,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 15:01:15,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 15:01:15,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 15:01:15,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 15:01:15,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 15:01:15,446 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:15,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 15:01:15,446 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 15:01:15,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 15:01:15,447 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:15,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 15:01:15,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 15:01:15,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732475452,5,FailOnTimeoutGroup] 2023-02-18 15:01:15,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732475453,5,FailOnTimeoutGroup] 2023-02-18 15:01:15,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 15:01:15,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,462 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:15,463 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:15,463 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa 2023-02-18 15:01:15,476 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:15,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:15,482 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/info 2023-02-18 15:01:15,483 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:15,484 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:15,484 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:15,485 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:15,486 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:15,487 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:15,487 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:15,488 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/table 2023-02-18 15:01:15,488 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:15,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:15,490 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740 2023-02-18 15:01:15,490 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740 2023-02-18 15:01:15,492 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:15,494 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:15,496 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:15,496 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60234857, jitterRate=-0.10243068635463715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:15,496 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:15,496 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:15,496 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:15,497 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:15,497 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:15,497 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:15,497 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:15,497 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:15,498 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:15,498 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 15:01:15,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 15:01:15,500 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 15:01:15,501 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 15:01:15,519 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(952): ClusterId : 4f3f06e6-3f69-4c10-ae3a-07921d24576b 2023-02-18 15:01:15,519 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(952): ClusterId : 4f3f06e6-3f69-4c10-ae3a-07921d24576b 2023-02-18 15:01:15,520 DEBUG [RS:1;jenkins-hbase4:42421] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:15,520 DEBUG [RS:0;jenkins-hbase4:37135] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:15,522 DEBUG [RS:0;jenkins-hbase4:37135] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:15,522 DEBUG [RS:0;jenkins-hbase4:37135] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:15,522 DEBUG [RS:1;jenkins-hbase4:42421] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:15,522 DEBUG [RS:1;jenkins-hbase4:42421] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:15,525 DEBUG [RS:0;jenkins-hbase4:37135] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:15,527 DEBUG [RS:0;jenkins-hbase4:37135] zookeeper.ReadOnlyZKClient(139): Connect 0x15820fde to 127.0.0.1:59779 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:15,527 DEBUG [RS:1;jenkins-hbase4:42421] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:15,528 DEBUG [RS:1;jenkins-hbase4:42421] zookeeper.ReadOnlyZKClient(139): Connect 0x42a20910 to 127.0.0.1:59779 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:15,536 DEBUG [RS:0;jenkins-hbase4:37135] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b45f31e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:15,536 DEBUG [RS:0;jenkins-hbase4:37135] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f7a64ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:15,536 DEBUG [RS:1;jenkins-hbase4:42421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c65ef34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:15,536 DEBUG [RS:1;jenkins-hbase4:42421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@485a6260, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:15,547 DEBUG [RS:1;jenkins-hbase4:42421] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42421 2023-02-18 15:01:15,547 INFO [RS:1;jenkins-hbase4:42421] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:15,547 INFO [RS:1;jenkins-hbase4:42421] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:15,547 DEBUG [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:15,548 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39403,1676732475097 with isa=jenkins-hbase4.apache.org/172.31.14.131:42421, startcode=1676732475196 2023-02-18 15:01:15,548 DEBUG [RS:1;jenkins-hbase4:42421] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:15,549 DEBUG [RS:0;jenkins-hbase4:37135] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37135 2023-02-18 15:01:15,549 INFO [RS:0;jenkins-hbase4:37135] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:15,549 INFO [RS:0;jenkins-hbase4:37135] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:15,549 DEBUG [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:15,550 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39403,1676732475097 with isa=jenkins-hbase4.apache.org/172.31.14.131:37135, startcode=1676732475162 2023-02-18 15:01:15,550 DEBUG [RS:0;jenkins-hbase4:37135] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:15,554 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48043, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:15,555 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60375, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:15,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39403] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:15,556 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:15,556 DEBUG [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa 2023-02-18 15:01:15,556 DEBUG [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32933 2023-02-18 15:01:15,556 DEBUG [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:15,557 DEBUG [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa 2023-02-18 15:01:15,557 DEBUG [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32933 2023-02-18 15:01:15,557 DEBUG [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:15,562 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:15,562 DEBUG [RS:1;jenkins-hbase4:42421] zookeeper.ZKUtil(162): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:15,562 DEBUG [RS:0;jenkins-hbase4:37135] zookeeper.ZKUtil(162): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:15,562 WARN [RS:1;jenkins-hbase4:42421] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:15,562 WARN [RS:0;jenkins-hbase4:37135] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:15,562 INFO [RS:1;jenkins-hbase4:42421] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:15,562 INFO [RS:0;jenkins-hbase4:37135] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:15,563 DEBUG [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/WALs/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:15,563 DEBUG [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/WALs/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:15,563 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42421,1676732475196] 2023-02-18 15:01:15,563 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37135,1676732475162] 2023-02-18 15:01:15,568 DEBUG [RS:1;jenkins-hbase4:42421] zookeeper.ZKUtil(162): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:15,568 DEBUG [RS:0;jenkins-hbase4:37135] zookeeper.ZKUtil(162): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:15,568 DEBUG [RS:1;jenkins-hbase4:42421] zookeeper.ZKUtil(162): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:15,568 DEBUG [RS:0;jenkins-hbase4:37135] zookeeper.ZKUtil(162): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:15,569 DEBUG [RS:1;jenkins-hbase4:42421] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:15,569 INFO [RS:1;jenkins-hbase4:42421] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:15,569 DEBUG [RS:0;jenkins-hbase4:37135] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:15,571 INFO [RS:0;jenkins-hbase4:37135] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:15,571 INFO [RS:1;jenkins-hbase4:42421] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:15,572 INFO [RS:1;jenkins-hbase4:42421] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:15,572 INFO [RS:1;jenkins-hbase4:42421] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,572 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:15,573 INFO [RS:1;jenkins-hbase4:42421] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,573 DEBUG [RS:1;jenkins-hbase4:42421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,573 DEBUG [RS:1;jenkins-hbase4:42421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,573 DEBUG [RS:1;jenkins-hbase4:42421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,573 DEBUG [RS:1;jenkins-hbase4:42421] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,573 DEBUG [RS:1;jenkins-hbase4:42421] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,573 DEBUG [RS:1;jenkins-hbase4:42421] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:15,573 DEBUG [RS:1;jenkins-hbase4:42421] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,574 DEBUG [RS:1;jenkins-hbase4:42421] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,574 DEBUG [RS:1;jenkins-hbase4:42421] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,574 DEBUG [RS:1;jenkins-hbase4:42421] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,576 INFO [RS:0;jenkins-hbase4:37135] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:15,576 INFO [RS:1;jenkins-hbase4:42421] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,576 INFO [RS:1;jenkins-hbase4:42421] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,577 INFO [RS:1;jenkins-hbase4:42421] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,580 INFO [RS:0;jenkins-hbase4:37135] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:15,580 INFO [RS:0;jenkins-hbase4:37135] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,580 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:15,581 INFO [RS:0;jenkins-hbase4:37135] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,581 DEBUG [RS:0;jenkins-hbase4:37135] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,581 DEBUG [RS:0;jenkins-hbase4:37135] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,581 DEBUG [RS:0;jenkins-hbase4:37135] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,581 DEBUG [RS:0;jenkins-hbase4:37135] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,581 DEBUG [RS:0;jenkins-hbase4:37135] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,582 DEBUG [RS:0;jenkins-hbase4:37135] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:15,582 DEBUG [RS:0;jenkins-hbase4:37135] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,582 DEBUG [RS:0;jenkins-hbase4:37135] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,582 DEBUG [RS:0;jenkins-hbase4:37135] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,582 DEBUG [RS:0;jenkins-hbase4:37135] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:15,584 INFO [RS:0;jenkins-hbase4:37135] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,584 INFO [RS:0;jenkins-hbase4:37135] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,584 INFO [RS:0;jenkins-hbase4:37135] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,593 INFO [RS:1;jenkins-hbase4:42421] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:15,593 INFO [RS:1;jenkins-hbase4:42421] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42421,1676732475196-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,598 INFO [RS:0;jenkins-hbase4:37135] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:15,598 INFO [RS:0;jenkins-hbase4:37135] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37135,1676732475162-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,613 INFO [RS:1;jenkins-hbase4:42421] regionserver.Replication(203): jenkins-hbase4.apache.org,42421,1676732475196 started 2023-02-18 15:01:15,613 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42421,1676732475196, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42421, sessionid=0x10067f3107c0002 2023-02-18 15:01:15,613 DEBUG [RS:1;jenkins-hbase4:42421] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:15,614 DEBUG [RS:1;jenkins-hbase4:42421] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:15,614 DEBUG [RS:1;jenkins-hbase4:42421] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42421,1676732475196' 2023-02-18 15:01:15,614 DEBUG [RS:1;jenkins-hbase4:42421] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:15,614 DEBUG [RS:1;jenkins-hbase4:42421] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:15,615 DEBUG [RS:1;jenkins-hbase4:42421] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:15,615 DEBUG [RS:1;jenkins-hbase4:42421] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:15,615 DEBUG [RS:1;jenkins-hbase4:42421] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:15,615 DEBUG [RS:1;jenkins-hbase4:42421] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42421,1676732475196' 2023-02-18 15:01:15,615 DEBUG [RS:1;jenkins-hbase4:42421] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:15,615 DEBUG [RS:1;jenkins-hbase4:42421] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:15,616 DEBUG [RS:1;jenkins-hbase4:42421] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:15,616 INFO [RS:1;jenkins-hbase4:42421] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:15,616 INFO [RS:1;jenkins-hbase4:42421] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:15,618 INFO [RS:0;jenkins-hbase4:37135] regionserver.Replication(203): jenkins-hbase4.apache.org,37135,1676732475162 started 2023-02-18 15:01:15,618 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37135,1676732475162, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37135, sessionid=0x10067f3107c0001 2023-02-18 15:01:15,618 DEBUG [RS:0;jenkins-hbase4:37135] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:15,618 DEBUG [RS:0;jenkins-hbase4:37135] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:15,618 DEBUG [RS:0;jenkins-hbase4:37135] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37135,1676732475162' 2023-02-18 15:01:15,618 DEBUG [RS:0;jenkins-hbase4:37135] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:15,618 DEBUG [RS:0;jenkins-hbase4:37135] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:15,619 DEBUG [RS:0;jenkins-hbase4:37135] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:15,619 DEBUG [RS:0;jenkins-hbase4:37135] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:15,619 DEBUG [RS:0;jenkins-hbase4:37135] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:15,619 DEBUG [RS:0;jenkins-hbase4:37135] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37135,1676732475162' 2023-02-18 15:01:15,619 DEBUG [RS:0;jenkins-hbase4:37135] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:15,620 DEBUG [RS:0;jenkins-hbase4:37135] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:15,620 DEBUG [RS:0;jenkins-hbase4:37135] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:15,620 INFO [RS:0;jenkins-hbase4:37135] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:15,620 INFO [RS:0;jenkins-hbase4:37135] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:15,652 DEBUG [jenkins-hbase4:39403] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 15:01:15,652 DEBUG [jenkins-hbase4:39403] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:15,654 DEBUG [jenkins-hbase4:39403] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:15,654 DEBUG [jenkins-hbase4:39403] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:15,654 DEBUG [jenkins-hbase4:39403] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:15,655 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37135,1676732475162, state=OPENING 2023-02-18 15:01:15,656 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 15:01:15,657 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:15,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37135,1676732475162}] 2023-02-18 15:01:15,658 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:15,819 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:15,820 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:15,823 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34788, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:15,828 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 15:01:15,828 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:15,830 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37135%2C1676732475162.meta, suffix=.meta, logDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/WALs/jenkins-hbase4.apache.org,37135,1676732475162, archiveDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/oldWALs, maxLogs=32 2023-02-18 15:01:15,856 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35095,DS-442adfec-2324-4fc5-9505-5be5bbc18a5c,DISK] 2023-02-18 15:01:15,857 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41735,DS-60e9e744-a36c-4570-9f6d-d5f34e994f7f,DISK] 2023-02-18 15:01:15,862 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/WALs/jenkins-hbase4.apache.org,37135,1676732475162/jenkins-hbase4.apache.org%2C37135%2C1676732475162.meta.1676732475832.meta 2023-02-18 15:01:15,863 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35095,DS-442adfec-2324-4fc5-9505-5be5bbc18a5c,DISK], DatanodeInfoWithStorage[127.0.0.1:41735,DS-60e9e744-a36c-4570-9f6d-d5f34e994f7f,DISK]] 2023-02-18 15:01:15,863 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:15,863 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 15:01:15,863 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 15:01:15,864 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 15:01:15,864 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 15:01:15,864 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:15,865 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 15:01:15,865 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 15:01:15,866 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:15,868 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/info 2023-02-18 15:01:15,868 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/info 2023-02-18 15:01:15,868 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:15,869 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:15,869 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:15,870 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:15,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:15,871 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:15,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:15,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:15,873 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/table 2023-02-18 15:01:15,873 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/table 2023-02-18 15:01:15,873 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:15,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:15,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740 2023-02-18 15:01:15,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740 2023-02-18 15:01:15,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:15,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:15,881 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72577279, jitterRate=0.08148573338985443}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:15,881 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:15,882 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676732475819 2023-02-18 15:01:15,886 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 15:01:15,887 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 15:01:15,888 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37135,1676732475162, state=OPEN 2023-02-18 15:01:15,891 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 15:01:15,891 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:15,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 15:01:15,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37135,1676732475162 in 233 msec 2023-02-18 15:01:15,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 15:01:15,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 395 msec 2023-02-18 15:01:15,897 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 457 msec 2023-02-18 15:01:15,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676732475897, completionTime=-1 2023-02-18 15:01:15,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 15:01:15,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 15:01:15,902 DEBUG [hconnection-0x6d93f74b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:15,905 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34804, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:15,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 15:01:15,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676732535907 2023-02-18 15:01:15,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676732595907 2023-02-18 15:01:15,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 10 msec 2023-02-18 15:01:15,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39403,1676732475097-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39403,1676732475097-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39403,1676732475097-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39403, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:15,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 15:01:15,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:15,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 15:01:15,918 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 15:01:15,920 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:15,920 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:15,922 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4 2023-02-18 15:01:15,923 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4 empty. 2023-02-18 15:01:15,923 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4 2023-02-18 15:01:15,923 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 15:01:15,940 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:15,942 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 76dfa65294103b8b3e6d208483cfe0e4, NAME => 'hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp 2023-02-18 15:01:15,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:15,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 76dfa65294103b8b3e6d208483cfe0e4, disabling compactions & flushes 2023-02-18 15:01:15,956 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:15,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:15,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. after waiting 0 ms 2023-02-18 15:01:15,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:15,956 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:15,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 76dfa65294103b8b3e6d208483cfe0e4: 2023-02-18 15:01:15,960 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:15,961 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732475961"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732475961"}]},"ts":"1676732475961"} 2023-02-18 15:01:15,964 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 15:01:15,968 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:15,968 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732475968"}]},"ts":"1676732475968"} 2023-02-18 15:01:15,973 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 15:01:15,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:15,984 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:15,984 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:15,984 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:15,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=76dfa65294103b8b3e6d208483cfe0e4, ASSIGN}] 2023-02-18 15:01:15,986 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=76dfa65294103b8b3e6d208483cfe0e4, ASSIGN 2023-02-18 15:01:15,987 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=76dfa65294103b8b3e6d208483cfe0e4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37135,1676732475162; forceNewPlan=false, retain=false 2023-02-18 15:01:16,138 INFO [jenkins-hbase4:39403] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 15:01:16,139 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=76dfa65294103b8b3e6d208483cfe0e4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:16,139 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732476139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732476139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732476139"}]},"ts":"1676732476139"} 2023-02-18 15:01:16,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 76dfa65294103b8b3e6d208483cfe0e4, server=jenkins-hbase4.apache.org,37135,1676732475162}] 2023-02-18 15:01:16,297 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:16,299 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37135%2C1676732475162, suffix=, logDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/WALs/jenkins-hbase4.apache.org,37135,1676732475162, archiveDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/oldWALs, maxLogs=32 2023-02-18 15:01:16,317 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35095,DS-442adfec-2324-4fc5-9505-5be5bbc18a5c,DISK] 2023-02-18 15:01:16,317 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41735,DS-60e9e744-a36c-4570-9f6d-d5f34e994f7f,DISK] 2023-02-18 15:01:16,322 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/WALs/jenkins-hbase4.apache.org,37135,1676732475162/jenkins-hbase4.apache.org%2C37135%2C1676732475162.1676732476300 2023-02-18 15:01:16,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41735,DS-60e9e744-a36c-4570-9f6d-d5f34e994f7f,DISK], DatanodeInfoWithStorage[127.0.0.1:35095,DS-442adfec-2324-4fc5-9505-5be5bbc18a5c,DISK]] 2023-02-18 15:01:16,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 76dfa65294103b8b3e6d208483cfe0e4, NAME => 'hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:16,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 76dfa65294103b8b3e6d208483cfe0e4 2023-02-18 15:01:16,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:16,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 76dfa65294103b8b3e6d208483cfe0e4 2023-02-18 15:01:16,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 76dfa65294103b8b3e6d208483cfe0e4 2023-02-18 15:01:16,324 INFO [StoreOpener-76dfa65294103b8b3e6d208483cfe0e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 76dfa65294103b8b3e6d208483cfe0e4 2023-02-18 15:01:16,325 DEBUG [StoreOpener-76dfa65294103b8b3e6d208483cfe0e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4/info 2023-02-18 15:01:16,325 DEBUG [StoreOpener-76dfa65294103b8b3e6d208483cfe0e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4/info 2023-02-18 15:01:16,326 INFO [StoreOpener-76dfa65294103b8b3e6d208483cfe0e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76dfa65294103b8b3e6d208483cfe0e4 columnFamilyName info 2023-02-18 15:01:16,326 INFO [StoreOpener-76dfa65294103b8b3e6d208483cfe0e4-1] regionserver.HStore(310): Store=76dfa65294103b8b3e6d208483cfe0e4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:16,327 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4 2023-02-18 15:01:16,328 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4 2023-02-18 15:01:16,331 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 76dfa65294103b8b3e6d208483cfe0e4 2023-02-18 15:01:16,334 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:16,335 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 76dfa65294103b8b3e6d208483cfe0e4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71034838, jitterRate=0.05850157141685486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:16,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 76dfa65294103b8b3e6d208483cfe0e4: 2023-02-18 15:01:16,336 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4., pid=6, masterSystemTime=1676732476293 2023-02-18 15:01:16,339 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:16,340 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:16,340 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=76dfa65294103b8b3e6d208483cfe0e4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:16,340 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732476340"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732476340"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732476340"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732476340"}]},"ts":"1676732476340"} 2023-02-18 15:01:16,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 15:01:16,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 76dfa65294103b8b3e6d208483cfe0e4, server=jenkins-hbase4.apache.org,37135,1676732475162 in 201 msec 2023-02-18 15:01:16,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 15:01:16,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=76dfa65294103b8b3e6d208483cfe0e4, ASSIGN in 360 msec 2023-02-18 15:01:16,347 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:16,348 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732476348"}]},"ts":"1676732476348"} 2023-02-18 15:01:16,349 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 15:01:16,353 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:16,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 436 msec 2023-02-18 15:01:16,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 15:01:16,421 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:16,421 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:16,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 15:01:16,435 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:16,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-18 15:01:16,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 15:01:16,458 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:16,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-18 15:01:16,473 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 15:01:16,477 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 15:01:16,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.252sec 2023-02-18 15:01:16,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 15:01:16,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 15:01:16,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 15:01:16,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39403,1676732475097-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 15:01:16,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39403,1676732475097-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 15:01:16,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 15:01:16,520 DEBUG [Listener at localhost/46609] zookeeper.ReadOnlyZKClient(139): Connect 0x2e065ace to 127.0.0.1:59779 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:16,526 DEBUG [Listener at localhost/46609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2648a37c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:16,528 DEBUG [hconnection-0xb6cb807-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:16,530 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34808, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:16,532 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39403,1676732475097 2023-02-18 15:01:16,532 DEBUG [Listener at localhost/46609] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 15:01:16,534 DEBUG [Listener at localhost/46609] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 15:01:16,536 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58402, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 15:01:16,537 INFO [Listener at localhost/46609] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 15:01:16,538 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-18 15:01:16,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 15:01:16,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:58402 deadline: 1676732536538, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-18 15:01:16,539 INFO [Listener at localhost/46609] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-18 15:01:16,542 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:16,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-18 15:01:16,546 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:16,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-18 15:01:16,547 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:16,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:16,556 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:16,556 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:16,556 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:16,556 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:16,556 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:16,556 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:16,556 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:16,556 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:16,557 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e empty. 2023-02-18 15:01:16,557 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5 empty. 2023-02-18 15:01:16,557 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463 empty. 2023-02-18 15:01:16,558 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919 empty. 2023-02-18 15:01:16,558 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a empty. 2023-02-18 15:01:16,558 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622 empty. 2023-02-18 15:01:16,558 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:16,558 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:16,558 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:16,558 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:16,558 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:16,559 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc empty. 2023-02-18 15:01:16,559 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe empty. 2023-02-18 15:01:16,559 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf empty. 2023-02-18 15:01:16,559 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:16,559 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c empty. 2023-02-18 15:01:16,559 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:16,559 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:16,559 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:16,560 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:16,560 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:16,560 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:16,560 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 15:01:16,575 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:16,577 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 90008c5ea3c222e0e54e8e39c9dfff9e, NAME => 'testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp 2023-02-18 15:01:16,577 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4cae14511ed442b847449e9510f13ebe, NAME => 'testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp 2023-02-18 15:01:16,577 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d2ca2b9b31116f5f35f780e617081622, NAME => 'testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp 2023-02-18 15:01:16,608 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:16,608 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4cae14511ed442b847449e9510f13ebe, disabling compactions & flushes 2023-02-18 15:01:16,609 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:16,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:16,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. after waiting 0 ms 2023-02-18 15:01:16,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:16,609 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:16,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4cae14511ed442b847449e9510f13ebe: 2023-02-18 15:01:16,609 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3960aa24086f70e10a20912542151ecc, NAME => 'testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp 2023-02-18 15:01:16,610 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:16,610 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d2ca2b9b31116f5f35f780e617081622, disabling compactions & flushes 2023-02-18 15:01:16,610 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:16,610 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:16,610 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. after waiting 0 ms 2023-02-18 15:01:16,611 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:16,611 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:16,611 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d2ca2b9b31116f5f35f780e617081622: 2023-02-18 15:01:16,611 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 70b18795206458e1174fc2cdebb02463, NAME => 'testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp 2023-02-18 15:01:16,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:16,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 90008c5ea3c222e0e54e8e39c9dfff9e, disabling compactions & flushes 2023-02-18 15:01:16,615 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:16,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:16,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. after waiting 0 ms 2023-02-18 15:01:16,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:16,615 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:16,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 90008c5ea3c222e0e54e8e39c9dfff9e: 2023-02-18 15:01:16,616 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e25baff02b43f460f4b436f6ee0282a5, NAME => 'testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp 2023-02-18 15:01:16,618 INFO [RS:1;jenkins-hbase4:42421] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42421%2C1676732475196, suffix=, logDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/WALs/jenkins-hbase4.apache.org,42421,1676732475196, archiveDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/oldWALs, maxLogs=32 2023-02-18 15:01:16,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:16,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 70b18795206458e1174fc2cdebb02463, disabling compactions & flushes 2023-02-18 15:01:16,635 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:16,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:16,636 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. after waiting 0 ms 2023-02-18 15:01:16,636 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:16,636 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:16,636 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 70b18795206458e1174fc2cdebb02463: 2023-02-18 15:01:16,636 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0dbc5c172d5fc74b7d700b64c781ca9a, NAME => 'testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp 2023-02-18 15:01:16,637 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:16,637 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e25baff02b43f460f4b436f6ee0282a5, disabling compactions & flushes 2023-02-18 15:01:16,638 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:16,638 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:16,638 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. after waiting 0 ms 2023-02-18 15:01:16,638 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:16,638 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:16,638 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e25baff02b43f460f4b436f6ee0282a5: 2023-02-18 15:01:16,638 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:16,642 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1467c8a0b279ac201d66904269e50919, NAME => 'testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp 2023-02-18 15:01:16,642 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3960aa24086f70e10a20912542151ecc, disabling compactions & flushes 2023-02-18 15:01:16,642 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:16,642 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:16,642 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. after waiting 0 ms 2023-02-18 15:01:16,642 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:16,642 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:16,642 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35095,DS-442adfec-2324-4fc5-9505-5be5bbc18a5c,DISK] 2023-02-18 15:01:16,642 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3960aa24086f70e10a20912542151ecc: 2023-02-18 15:01:16,643 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41735,DS-60e9e744-a36c-4570-9f6d-d5f34e994f7f,DISK] 2023-02-18 15:01:16,644 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e2a34af80dd34758100e2f6655c2e29c, NAME => 'testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp 2023-02-18 15:01:16,648 INFO [RS:1;jenkins-hbase4:42421] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/WALs/jenkins-hbase4.apache.org,42421,1676732475196/jenkins-hbase4.apache.org%2C42421%2C1676732475196.1676732476618 2023-02-18 15:01:16,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:16,650 DEBUG [RS:1;jenkins-hbase4:42421] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35095,DS-442adfec-2324-4fc5-9505-5be5bbc18a5c,DISK], DatanodeInfoWithStorage[127.0.0.1:41735,DS-60e9e744-a36c-4570-9f6d-d5f34e994f7f,DISK]] 2023-02-18 15:01:16,676 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:16,676 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 0dbc5c172d5fc74b7d700b64c781ca9a, disabling compactions & flushes 2023-02-18 15:01:16,676 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:16,677 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:16,677 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. after waiting 0 ms 2023-02-18 15:01:16,677 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:16,677 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:16,677 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 0dbc5c172d5fc74b7d700b64c781ca9a: 2023-02-18 15:01:16,677 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => b98a94ebff502da1d4174cd4ce4e5ccf, NAME => 'testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.tmp 2023-02-18 15:01:16,682 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:16,683 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 1467c8a0b279ac201d66904269e50919, disabling compactions & flushes 2023-02-18 15:01:16,683 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:16,683 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:16,683 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. after waiting 0 ms 2023-02-18 15:01:16,683 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:16,683 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:16,683 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 1467c8a0b279ac201d66904269e50919: 2023-02-18 15:01:16,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:16,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e2a34af80dd34758100e2f6655c2e29c, disabling compactions & flushes 2023-02-18 15:01:16,685 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:16,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:16,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. after waiting 0 ms 2023-02-18 15:01:16,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:16,685 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:16,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e2a34af80dd34758100e2f6655c2e29c: 2023-02-18 15:01:16,693 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:16,693 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing b98a94ebff502da1d4174cd4ce4e5ccf, disabling compactions & flushes 2023-02-18 15:01:16,693 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:16,693 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:16,693 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. after waiting 0 ms 2023-02-18 15:01:16,693 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:16,693 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:16,693 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for b98a94ebff502da1d4174cd4ce4e5ccf: 2023-02-18 15:01:16,696 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:16,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732476697"}]},"ts":"1676732476697"} 2023-02-18 15:01:16,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732476697"}]},"ts":"1676732476697"} 2023-02-18 15:01:16,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732476697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732476697"}]},"ts":"1676732476697"} 2023-02-18 15:01:16,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732476697"}]},"ts":"1676732476697"} 2023-02-18 15:01:16,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732476697"}]},"ts":"1676732476697"} 2023-02-18 15:01:16,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676732476541.3960aa24086f70e10a20912542151ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732476697"}]},"ts":"1676732476697"} 2023-02-18 15:01:16,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732476697"}]},"ts":"1676732476697"} 2023-02-18 15:01:16,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732476697"}]},"ts":"1676732476697"} 2023-02-18 15:01:16,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732476697"}]},"ts":"1676732476697"} 2023-02-18 15:01:16,698 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732476697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732476697"}]},"ts":"1676732476697"} 2023-02-18 15:01:16,700 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-18 15:01:16,701 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:16,701 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732476701"}]},"ts":"1676732476701"} 2023-02-18 15:01:16,703 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-18 15:01:16,708 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:16,717 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:16,717 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:16,717 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:16,717 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=90008c5ea3c222e0e54e8e39c9dfff9e, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d2ca2b9b31116f5f35f780e617081622, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4cae14511ed442b847449e9510f13ebe, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3960aa24086f70e10a20912542151ecc, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=70b18795206458e1174fc2cdebb02463, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e25baff02b43f460f4b436f6ee0282a5, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0dbc5c172d5fc74b7d700b64c781ca9a, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1467c8a0b279ac201d66904269e50919, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e2a34af80dd34758100e2f6655c2e29c, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b98a94ebff502da1d4174cd4ce4e5ccf, ASSIGN}] 2023-02-18 15:01:16,720 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d2ca2b9b31116f5f35f780e617081622, ASSIGN 2023-02-18 15:01:16,720 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=90008c5ea3c222e0e54e8e39c9dfff9e, ASSIGN 2023-02-18 15:01:16,720 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3960aa24086f70e10a20912542151ecc, ASSIGN 2023-02-18 15:01:16,720 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=70b18795206458e1174fc2cdebb02463, ASSIGN 2023-02-18 15:01:16,721 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d2ca2b9b31116f5f35f780e617081622, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37135,1676732475162; forceNewPlan=false, retain=false 2023-02-18 15:01:16,722 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=90008c5ea3c222e0e54e8e39c9dfff9e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42421,1676732475196; forceNewPlan=false, retain=false 2023-02-18 15:01:16,722 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3960aa24086f70e10a20912542151ecc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37135,1676732475162; forceNewPlan=false, retain=false 2023-02-18 15:01:16,722 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=70b18795206458e1174fc2cdebb02463, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37135,1676732475162; forceNewPlan=false, retain=false 2023-02-18 15:01:16,722 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b98a94ebff502da1d4174cd4ce4e5ccf, ASSIGN 2023-02-18 15:01:16,723 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e2a34af80dd34758100e2f6655c2e29c, ASSIGN 2023-02-18 15:01:16,723 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1467c8a0b279ac201d66904269e50919, ASSIGN 2023-02-18 15:01:16,723 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b98a94ebff502da1d4174cd4ce4e5ccf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37135,1676732475162; forceNewPlan=false, retain=false 2023-02-18 15:01:16,723 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0dbc5c172d5fc74b7d700b64c781ca9a, ASSIGN 2023-02-18 15:01:16,723 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e25baff02b43f460f4b436f6ee0282a5, ASSIGN 2023-02-18 15:01:16,723 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e2a34af80dd34758100e2f6655c2e29c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42421,1676732475196; forceNewPlan=false, retain=false 2023-02-18 15:01:16,724 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1467c8a0b279ac201d66904269e50919, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37135,1676732475162; forceNewPlan=false, retain=false 2023-02-18 15:01:16,724 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4cae14511ed442b847449e9510f13ebe, ASSIGN 2023-02-18 15:01:16,724 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e25baff02b43f460f4b436f6ee0282a5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42421,1676732475196; forceNewPlan=false, retain=false 2023-02-18 15:01:16,724 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0dbc5c172d5fc74b7d700b64c781ca9a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42421,1676732475196; forceNewPlan=false, retain=false 2023-02-18 15:01:16,725 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4cae14511ed442b847449e9510f13ebe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42421,1676732475196; forceNewPlan=false, retain=false 2023-02-18 15:01:16,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:16,872 INFO [jenkins-hbase4:39403] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-18 15:01:16,876 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4cae14511ed442b847449e9510f13ebe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:16,876 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0dbc5c172d5fc74b7d700b64c781ca9a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:16,876 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=90008c5ea3c222e0e54e8e39c9dfff9e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:16,876 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e2a34af80dd34758100e2f6655c2e29c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:16,876 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732476876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732476876"}]},"ts":"1676732476876"} 2023-02-18 15:01:16,876 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e25baff02b43f460f4b436f6ee0282a5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:16,876 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732476876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732476876"}]},"ts":"1676732476876"} 2023-02-18 15:01:16,876 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732476876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732476876"}]},"ts":"1676732476876"} 2023-02-18 15:01:16,876 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732476876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732476876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732476876"}]},"ts":"1676732476876"} 2023-02-18 15:01:16,876 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732476876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732476876"}]},"ts":"1676732476876"} 2023-02-18 15:01:16,879 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; OpenRegionProcedure 0dbc5c172d5fc74b7d700b64c781ca9a, server=jenkins-hbase4.apache.org,42421,1676732475196}] 2023-02-18 15:01:16,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure e2a34af80dd34758100e2f6655c2e29c, server=jenkins-hbase4.apache.org,42421,1676732475196}] 2023-02-18 15:01:16,881 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=16, state=RUNNABLE; OpenRegionProcedure e25baff02b43f460f4b436f6ee0282a5, server=jenkins-hbase4.apache.org,42421,1676732475196}] 2023-02-18 15:01:16,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 90008c5ea3c222e0e54e8e39c9dfff9e, server=jenkins-hbase4.apache.org,42421,1676732475196}] 2023-02-18 15:01:16,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=13, state=RUNNABLE; OpenRegionProcedure 4cae14511ed442b847449e9510f13ebe, server=jenkins-hbase4.apache.org,42421,1676732475196}] 2023-02-18 15:01:16,886 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b98a94ebff502da1d4174cd4ce4e5ccf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:16,886 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732476886"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732476886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732476886"}]},"ts":"1676732476886"} 2023-02-18 15:01:16,889 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3960aa24086f70e10a20912542151ecc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:16,889 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d2ca2b9b31116f5f35f780e617081622, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:16,889 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676732476541.3960aa24086f70e10a20912542151ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732476889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732476889"}]},"ts":"1676732476889"} 2023-02-18 15:01:16,889 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732476889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732476889"}]},"ts":"1676732476889"} 2023-02-18 15:01:16,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure b98a94ebff502da1d4174cd4ce4e5ccf, server=jenkins-hbase4.apache.org,37135,1676732475162}] 2023-02-18 15:01:16,892 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=70b18795206458e1174fc2cdebb02463, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:16,892 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476892"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732476892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732476892"}]},"ts":"1676732476892"} 2023-02-18 15:01:16,892 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure 3960aa24086f70e10a20912542151ecc, server=jenkins-hbase4.apache.org,37135,1676732475162}] 2023-02-18 15:01:16,893 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=1467c8a0b279ac201d66904269e50919, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:16,893 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732476893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732476893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732476893"}]},"ts":"1676732476893"} 2023-02-18 15:01:16,894 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure d2ca2b9b31116f5f35f780e617081622, server=jenkins-hbase4.apache.org,37135,1676732475162}] 2023-02-18 15:01:16,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure 1467c8a0b279ac201d66904269e50919, server=jenkins-hbase4.apache.org,37135,1676732475162}] 2023-02-18 15:01:16,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 70b18795206458e1174fc2cdebb02463, server=jenkins-hbase4.apache.org,37135,1676732475162}] 2023-02-18 15:01:17,032 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:17,033 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:17,035 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39202, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:17,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:17,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 90008c5ea3c222e0e54e8e39c9dfff9e, NAME => 'testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-18 15:01:17,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:17,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:17,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:17,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:17,041 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:17,042 DEBUG [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e/f1 2023-02-18 15:01:17,042 DEBUG [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e/f1 2023-02-18 15:01:17,043 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90008c5ea3c222e0e54e8e39c9dfff9e columnFamilyName f1 2023-02-18 15:01:17,043 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] regionserver.HStore(310): Store=90008c5ea3c222e0e54e8e39c9dfff9e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,044 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:17,045 DEBUG [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e/f2 2023-02-18 15:01:17,045 DEBUG [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e/f2 2023-02-18 15:01:17,045 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90008c5ea3c222e0e54e8e39c9dfff9e columnFamilyName f2 2023-02-18 15:01:17,046 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] regionserver.HStore(310): Store=90008c5ea3c222e0e54e8e39c9dfff9e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:17,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:17,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:17,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3960aa24086f70e10a20912542151ecc, NAME => 'testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-18 15:01:17,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:17,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:17,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:17,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:17,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:17,050 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:17,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:17,051 DEBUG [StoreOpener-3960aa24086f70e10a20912542151ecc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f1 2023-02-18 15:01:17,051 DEBUG [StoreOpener-3960aa24086f70e10a20912542151ecc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f1 2023-02-18 15:01:17,052 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3960aa24086f70e10a20912542151ecc columnFamilyName f1 2023-02-18 15:01:17,052 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] regionserver.HStore(310): Store=3960aa24086f70e10a20912542151ecc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,052 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:17,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:17,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 90008c5ea3c222e0e54e8e39c9dfff9e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71867037, jitterRate=0.07090230286121368}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:17,055 DEBUG [StoreOpener-3960aa24086f70e10a20912542151ecc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f2 2023-02-18 15:01:17,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 90008c5ea3c222e0e54e8e39c9dfff9e: 2023-02-18 15:01:17,055 DEBUG [StoreOpener-3960aa24086f70e10a20912542151ecc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f2 2023-02-18 15:01:17,055 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3960aa24086f70e10a20912542151ecc columnFamilyName f2 2023-02-18 15:01:17,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e., pid=24, masterSystemTime=1676732477032 2023-02-18 15:01:17,058 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] regionserver.HStore(310): Store=3960aa24086f70e10a20912542151ecc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:17,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:17,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:17,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:17,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:17,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0dbc5c172d5fc74b7d700b64c781ca9a, NAME => 'testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-18 15:01:17,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:17,060 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=90008c5ea3c222e0e54e8e39c9dfff9e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:17,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:17,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:17,060 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732477060"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732477060"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732477060"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732477060"}]},"ts":"1676732477060"} 2023-02-18 15:01:17,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:17,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:17,062 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:17,063 DEBUG [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f1 2023-02-18 15:01:17,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:17,063 DEBUG [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f1 2023-02-18 15:01:17,064 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0dbc5c172d5fc74b7d700b64c781ca9a columnFamilyName f1 2023-02-18 15:01:17,064 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-18 15:01:17,064 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 90008c5ea3c222e0e54e8e39c9dfff9e, server=jenkins-hbase4.apache.org,42421,1676732475196 in 179 msec 2023-02-18 15:01:17,065 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] regionserver.HStore(310): Store=0dbc5c172d5fc74b7d700b64c781ca9a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,065 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:17,066 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=90008c5ea3c222e0e54e8e39c9dfff9e, ASSIGN in 347 msec 2023-02-18 15:01:17,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:17,067 DEBUG [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f2 2023-02-18 15:01:17,067 DEBUG [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f2 2023-02-18 15:01:17,067 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0dbc5c172d5fc74b7d700b64c781ca9a columnFamilyName f2 2023-02-18 15:01:17,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3960aa24086f70e10a20912542151ecc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66127761, jitterRate=-0.014619573950767517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:17,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3960aa24086f70e10a20912542151ecc: 2023-02-18 15:01:17,068 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] regionserver.HStore(310): Store=0dbc5c172d5fc74b7d700b64c781ca9a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc., pid=27, masterSystemTime=1676732477044 2023-02-18 15:01:17,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:17,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:17,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:17,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:17,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:17,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d2ca2b9b31116f5f35f780e617081622, NAME => 'testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-18 15:01:17,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:17,070 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3960aa24086f70e10a20912542151ecc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:17,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:17,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:17,071 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676732476541.3960aa24086f70e10a20912542151ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732477070"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732477070"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732477070"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732477070"}]},"ts":"1676732477070"} 2023-02-18 15:01:17,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:17,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:17,073 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:17,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:17,075 DEBUG [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f1 2023-02-18 15:01:17,075 DEBUG [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f1 2023-02-18 15:01:17,075 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2ca2b9b31116f5f35f780e617081622 columnFamilyName f1 2023-02-18 15:01:17,076 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] regionserver.HStore(310): Store=d2ca2b9b31116f5f35f780e617081622/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,076 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:17,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:17,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-18 15:01:17,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure 3960aa24086f70e10a20912542151ecc, server=jenkins-hbase4.apache.org,37135,1676732475162 in 181 msec 2023-02-18 15:01:17,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0dbc5c172d5fc74b7d700b64c781ca9a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72645720, jitterRate=0.08250558376312256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:17,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0dbc5c172d5fc74b7d700b64c781ca9a: 2023-02-18 15:01:17,077 DEBUG [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f2 2023-02-18 15:01:17,077 DEBUG [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f2 2023-02-18 15:01:17,078 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2ca2b9b31116f5f35f780e617081622 columnFamilyName f2 2023-02-18 15:01:17,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a., pid=21, masterSystemTime=1676732477032 2023-02-18 15:01:17,078 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3960aa24086f70e10a20912542151ecc, ASSIGN in 360 msec 2023-02-18 15:01:17,078 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] regionserver.HStore(310): Store=d2ca2b9b31116f5f35f780e617081622/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:17,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:17,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:17,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:17,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:17,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e2a34af80dd34758100e2f6655c2e29c, NAME => 'testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-18 15:01:17,080 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0dbc5c172d5fc74b7d700b64c781ca9a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:17,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:17,080 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732477080"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732477080"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732477080"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732477080"}]},"ts":"1676732477080"} 2023-02-18 15:01:17,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:17,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:17,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:17,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:17,082 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:17,084 DEBUG [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f1 2023-02-18 15:01:17,084 DEBUG [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f1 2023-02-18 15:01:17,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=17 2023-02-18 15:01:17,084 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2a34af80dd34758100e2f6655c2e29c columnFamilyName f1 2023-02-18 15:01:17,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=17, state=SUCCESS; OpenRegionProcedure 0dbc5c172d5fc74b7d700b64c781ca9a, server=jenkins-hbase4.apache.org,42421,1676732475196 in 203 msec 2023-02-18 15:01:17,085 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] regionserver.HStore(310): Store=e2a34af80dd34758100e2f6655c2e29c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,085 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:17,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0dbc5c172d5fc74b7d700b64c781ca9a, ASSIGN in 367 msec 2023-02-18 15:01:17,087 DEBUG [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f2 2023-02-18 15:01:17,087 DEBUG [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f2 2023-02-18 15:01:17,087 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2a34af80dd34758100e2f6655c2e29c columnFamilyName f2 2023-02-18 15:01:17,088 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] regionserver.HStore(310): Store=e2a34af80dd34758100e2f6655c2e29c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:17,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:17,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d2ca2b9b31116f5f35f780e617081622; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70491589, jitterRate=0.05040653049945831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d2ca2b9b31116f5f35f780e617081622: 2023-02-18 15:01:17,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622., pid=28, masterSystemTime=1676732477044 2023-02-18 15:01:17,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:17,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:17,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:17,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:17,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b98a94ebff502da1d4174cd4ce4e5ccf, NAME => 'testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-18 15:01:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:17,100 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d2ca2b9b31116f5f35f780e617081622, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:17,100 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732477100"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732477100"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732477100"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732477100"}]},"ts":"1676732477100"} 2023-02-18 15:01:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:17,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-18 15:01:17,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure d2ca2b9b31116f5f35f780e617081622, server=jenkins-hbase4.apache.org,37135,1676732475162 in 208 msec 2023-02-18 15:01:17,104 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:17,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:17,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d2ca2b9b31116f5f35f780e617081622, ASSIGN in 387 msec 2023-02-18 15:01:17,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e2a34af80dd34758100e2f6655c2e29c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66629130, jitterRate=-0.0071485936641693115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:17,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e2a34af80dd34758100e2f6655c2e29c: 2023-02-18 15:01:17,106 DEBUG [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf/f1 2023-02-18 15:01:17,106 DEBUG [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf/f1 2023-02-18 15:01:17,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c., pid=22, masterSystemTime=1676732477032 2023-02-18 15:01:17,107 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b98a94ebff502da1d4174cd4ce4e5ccf columnFamilyName f1 2023-02-18 15:01:17,107 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] regionserver.HStore(310): Store=b98a94ebff502da1d4174cd4ce4e5ccf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,107 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:17,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:17,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:17,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:17,109 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e2a34af80dd34758100e2f6655c2e29c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e25baff02b43f460f4b436f6ee0282a5, NAME => 'testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-18 15:01:17,109 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732477108"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732477108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732477108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732477108"}]},"ts":"1676732477108"} 2023-02-18 15:01:17,109 DEBUG [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf/f2 2023-02-18 15:01:17,109 DEBUG [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf/f2 2023-02-18 15:01:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:17,109 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b98a94ebff502da1d4174cd4ce4e5ccf columnFamilyName f2 2023-02-18 15:01:17,110 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] regionserver.HStore(310): Store=b98a94ebff502da1d4174cd4ce4e5ccf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:17,112 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:17,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:17,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-18 15:01:17,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure e2a34af80dd34758100e2f6655c2e29c, server=jenkins-hbase4.apache.org,42421,1676732475196 in 230 msec 2023-02-18 15:01:17,114 DEBUG [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f1 2023-02-18 15:01:17,114 DEBUG [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f1 2023-02-18 15:01:17,114 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e25baff02b43f460f4b436f6ee0282a5 columnFamilyName f1 2023-02-18 15:01:17,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:17,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e2a34af80dd34758100e2f6655c2e29c, ASSIGN in 396 msec 2023-02-18 15:01:17,115 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] regionserver.HStore(310): Store=e25baff02b43f460f4b436f6ee0282a5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,115 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:17,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:17,116 DEBUG [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f2 2023-02-18 15:01:17,116 DEBUG [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f2 2023-02-18 15:01:17,117 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e25baff02b43f460f4b436f6ee0282a5 columnFamilyName f2 2023-02-18 15:01:17,117 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] regionserver.HStore(310): Store=e25baff02b43f460f4b436f6ee0282a5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:17,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:17,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:17,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b98a94ebff502da1d4174cd4ce4e5ccf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68304013, jitterRate=0.017809107899665833}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:17,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b98a94ebff502da1d4174cd4ce4e5ccf: 2023-02-18 15:01:17,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf., pid=26, masterSystemTime=1676732477044 2023-02-18 15:01:17,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:17,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:17,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:17,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:17,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1467c8a0b279ac201d66904269e50919, NAME => 'testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-18 15:01:17,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:17,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:17,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:17,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:17,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:17,130 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:17,128 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b98a94ebff502da1d4174cd4ce4e5ccf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:17,130 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676732477128"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732477128"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732477128"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732477128"}]},"ts":"1676732477128"} 2023-02-18 15:01:17,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:17,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-18 15:01:17,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure b98a94ebff502da1d4174cd4ce4e5ccf, server=jenkins-hbase4.apache.org,37135,1676732475162 in 243 msec 2023-02-18 15:01:17,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e25baff02b43f460f4b436f6ee0282a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66291541, jitterRate=-0.012179061770439148}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:17,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e25baff02b43f460f4b436f6ee0282a5: 2023-02-18 15:01:17,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5., pid=23, masterSystemTime=1676732477032 2023-02-18 15:01:17,136 DEBUG [StoreOpener-1467c8a0b279ac201d66904269e50919-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f1 2023-02-18 15:01:17,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b98a94ebff502da1d4174cd4ce4e5ccf, ASSIGN in 417 msec 2023-02-18 15:01:17,136 DEBUG [StoreOpener-1467c8a0b279ac201d66904269e50919-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f1 2023-02-18 15:01:17,136 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1467c8a0b279ac201d66904269e50919 columnFamilyName f1 2023-02-18 15:01:17,137 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] regionserver.HStore(310): Store=1467c8a0b279ac201d66904269e50919/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,137 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:17,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:17,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:17,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:17,138 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e25baff02b43f460f4b436f6ee0282a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:17,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4cae14511ed442b847449e9510f13ebe, NAME => 'testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-18 15:01:17,138 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732477138"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732477138"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732477138"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732477138"}]},"ts":"1676732477138"} 2023-02-18 15:01:17,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:17,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:17,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:17,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:17,139 DEBUG [StoreOpener-1467c8a0b279ac201d66904269e50919-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f2 2023-02-18 15:01:17,139 DEBUG [StoreOpener-1467c8a0b279ac201d66904269e50919-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f2 2023-02-18 15:01:17,140 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1467c8a0b279ac201d66904269e50919 columnFamilyName f2 2023-02-18 15:01:17,140 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:17,140 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] regionserver.HStore(310): Store=1467c8a0b279ac201d66904269e50919/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=16 2023-02-18 15:01:17,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=16, state=SUCCESS; OpenRegionProcedure e25baff02b43f460f4b436f6ee0282a5, server=jenkins-hbase4.apache.org,42421,1676732475196 in 259 msec 2023-02-18 15:01:17,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:17,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:17,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e25baff02b43f460f4b436f6ee0282a5, ASSIGN in 425 msec 2023-02-18 15:01:17,143 DEBUG [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f1 2023-02-18 15:01:17,143 DEBUG [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f1 2023-02-18 15:01:17,144 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4cae14511ed442b847449e9510f13ebe columnFamilyName f1 2023-02-18 15:01:17,144 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] regionserver.HStore(310): Store=4cae14511ed442b847449e9510f13ebe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,144 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:17,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:17,146 DEBUG [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f2 2023-02-18 15:01:17,146 DEBUG [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f2 2023-02-18 15:01:17,146 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4cae14511ed442b847449e9510f13ebe columnFamilyName f2 2023-02-18 15:01:17,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:17,146 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] regionserver.HStore(310): Store=4cae14511ed442b847449e9510f13ebe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:17,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:17,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:17,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1467c8a0b279ac201d66904269e50919; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62186617, jitterRate=-0.07334719598293304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:17,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1467c8a0b279ac201d66904269e50919: 2023-02-18 15:01:17,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919., pid=29, masterSystemTime=1676732477044 2023-02-18 15:01:17,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:17,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:17,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:17,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:17,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 70b18795206458e1174fc2cdebb02463, NAME => 'testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-18 15:01:17,151 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=1467c8a0b279ac201d66904269e50919, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:17,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:17,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:17,151 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732477151"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732477151"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732477151"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732477151"}]},"ts":"1676732477151"} 2023-02-18 15:01:17,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:17,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:17,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:17,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:17,153 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:17,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:17,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4cae14511ed442b847449e9510f13ebe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73699597, jitterRate=0.09820957481861115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:17,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4cae14511ed442b847449e9510f13ebe: 2023-02-18 15:01:17,155 DEBUG [StoreOpener-70b18795206458e1174fc2cdebb02463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f1 2023-02-18 15:01:17,155 DEBUG [StoreOpener-70b18795206458e1174fc2cdebb02463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f1 2023-02-18 15:01:17,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-18 15:01:17,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe., pid=25, masterSystemTime=1676732477032 2023-02-18 15:01:17,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure 1467c8a0b279ac201d66904269e50919, server=jenkins-hbase4.apache.org,37135,1676732475162 in 257 msec 2023-02-18 15:01:17,155 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70b18795206458e1174fc2cdebb02463 columnFamilyName f1 2023-02-18 15:01:17,156 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] regionserver.HStore(310): Store=70b18795206458e1174fc2cdebb02463/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,156 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:17,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1467c8a0b279ac201d66904269e50919, ASSIGN in 438 msec 2023-02-18 15:01:17,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:17,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:17,157 DEBUG [StoreOpener-70b18795206458e1174fc2cdebb02463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f2 2023-02-18 15:01:17,157 DEBUG [StoreOpener-70b18795206458e1174fc2cdebb02463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f2 2023-02-18 15:01:17,158 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4cae14511ed442b847449e9510f13ebe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:17,158 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732477158"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732477158"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732477158"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732477158"}]},"ts":"1676732477158"} 2023-02-18 15:01:17,158 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70b18795206458e1174fc2cdebb02463 columnFamilyName f2 2023-02-18 15:01:17,158 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] regionserver.HStore(310): Store=70b18795206458e1174fc2cdebb02463/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:17,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:17,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:17,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=13 2023-02-18 15:01:17,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=13, state=SUCCESS; OpenRegionProcedure 4cae14511ed442b847449e9510f13ebe, server=jenkins-hbase4.apache.org,42421,1676732475196 in 275 msec 2023-02-18 15:01:17,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:17,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4cae14511ed442b847449e9510f13ebe, ASSIGN in 444 msec 2023-02-18 15:01:17,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:17,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:17,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 70b18795206458e1174fc2cdebb02463; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61898666, jitterRate=-0.07763800024986267}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:17,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 70b18795206458e1174fc2cdebb02463: 2023-02-18 15:01:17,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463., pid=30, masterSystemTime=1676732477044 2023-02-18 15:01:17,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:17,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:17,168 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=70b18795206458e1174fc2cdebb02463, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:17,168 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676732477168"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732477168"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732477168"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732477168"}]},"ts":"1676732477168"} 2023-02-18 15:01:17,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-18 15:01:17,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 70b18795206458e1174fc2cdebb02463, server=jenkins-hbase4.apache.org,37135,1676732475162 in 274 msec 2023-02-18 15:01:17,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-18 15:01:17,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=70b18795206458e1174fc2cdebb02463, ASSIGN in 454 msec 2023-02-18 15:01:17,174 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:17,174 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732477174"}]},"ts":"1676732477174"} 2023-02-18 15:01:17,175 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-18 15:01:17,177 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:17,179 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 635 msec 2023-02-18 15:01:17,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:17,662 INFO [Listener at localhost/46609] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-18 15:01:17,663 DEBUG [Listener at localhost/46609] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-18 15:01:17,663 INFO [Listener at localhost/46609] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:17,668 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-18 15:01:17,668 INFO [Listener at localhost/46609] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:17,668 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-18 15:01:17,668 INFO [Listener at localhost/46609] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 15:01:17,737 DEBUG [hconnection-0xb6cb807-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:17,773 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39208, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:17,795 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42421] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:17,795 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37135] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:17,946 INFO [Listener at localhost/46609] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 15:01:17,947 INFO [Listener at localhost/46609] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 15:01:17,948 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 15:01:17,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676732477948 (current time:1676732477948). 2023-02-18 15:01:17,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 15:01:17,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] zookeeper.ReadOnlyZKClient(139): Connect 0x183103fa to 127.0.0.1:59779 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:17,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e20f458, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:17,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:17,971 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34814, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:17,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x183103fa to 127.0.0.1:59779 2023-02-18 15:01:17,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:17,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 15:01:17,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 15:01:17,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 15:01:17,976 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 15:01:17,977 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676733077977 2023-02-18 15:01:17,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 15:01:17,977 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-18 15:01:17,978 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:17,978 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 15:01:17,979 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 15:01:17,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 15:01:17,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-18 15:01:17,980 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 15:01:17,981 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676733077981 2023-02-18 15:01:18,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,004 INFO [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-18 15:01:18,004 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:18,005 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-18 15:01:18,005 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-18 15:01:18,006 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,006 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,008 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:18,008 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:18,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:18,008 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:18,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:18,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:18,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:18,009 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:18,009 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:18,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,012 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:18,012 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:18,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-18 15:01:18,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,013 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 15:01:18,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-18 15:01:18,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,013 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 15:01:18,013 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-18 15:01:18,013 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-18 15:01:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-18 15:01:18,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42421,1676732475196' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-18 15:01:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-18 15:01:18,020 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:18,019 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:18,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:18,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:18,020 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:18,024 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,024 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-18 15:01:18,024 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-18 15:01:18,024 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:18,024 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37135,1676732475162' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-18 15:01:18,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:18,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:18,026 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:18,026 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,027 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,027 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:18,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:18,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:18,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:18,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42421,1676732475196' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-18 15:01:18,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@377a33c6[Count = 1] remaining members to acquire global barrier 2023-02-18 15:01:18,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:18,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:18,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:18,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:18,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:18,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:18,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:18,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:18,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37135,1676732475162' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-18 15:01:18,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@377a33c6[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:18,031 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-18 15:01:18,031 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,032 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,032 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,032 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-18 15:01:18,032 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:18,032 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-18 15:01:18,033 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:18,033 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:18,036 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:18,036 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. started... 2023-02-18 15:01:18,044 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:18,044 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e2a34af80dd34758100e2f6655c2e29c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 15:01:18,044 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:18,044 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. started... 2023-02-18 15:01:18,044 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. started... 2023-02-18 15:01:18,050 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 15:01:18,050 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 15:01:18,051 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:18,051 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. started... 2023-02-18 15:01:18,059 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e25baff02b43f460f4b436f6ee0282a5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:18,062 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:18,061 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 15:01:18,062 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 15:01:18,060 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:18,063 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. started... 2023-02-18 15:01:18,059 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1467c8a0b279ac201d66904269e50919 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:18,066 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. started... 2023-02-18 15:01:18,066 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 90008c5ea3c222e0e54e8e39c9dfff9e: 2023-02-18 15:01:18,067 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,067 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:18,067 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:18,068 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:18,068 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d2ca2b9b31116f5f35f780e617081622 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 15:01:18,075 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b98a94ebff502da1d4174cd4ce4e5ccf: 2023-02-18 15:01:18,077 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,077 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:18,077 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:18,077 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:18,078 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:18,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:18,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:18,081 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 15:01:18,132 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. completed. 2023-02-18 15:01:18,132 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:18,132 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:18,132 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 15:01:18,132 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. started... 2023-02-18 15:01:18,135 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 0dbc5c172d5fc74b7d700b64c781ca9a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:18,164 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 15:01:18,184 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/.tmp/f1/e4871ad6f67b42d187776a5479e60a8d 2023-02-18 15:01:18,210 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/.tmp/f1/7d9068d9e68549479feb6db13892c0a3 2023-02-18 15:01:18,240 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/.tmp/f1/9e50833b32c94c828aab5f95d687aac7 2023-02-18 15:01:18,278 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. completed. 2023-02-18 15:01:18,278 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:18,278 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:18,278 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 15:01:18,278 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. started... 2023-02-18 15:01:18,279 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3960aa24086f70e10a20912542151ecc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:18,281 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:18,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:18,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:18,283 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-18 15:01:18,306 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/.tmp/f1/81818eecc94c4d94b718087a6f6422fe 2023-02-18 15:01:18,306 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/.tmp/f1/43387f73e9d144f6997df2bea2c70827 2023-02-18 15:01:18,328 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/.tmp/f2/8fcc4282e79948cf91a9093ac5179df9 2023-02-18 15:01:18,354 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/.tmp/f1/e4871ad6f67b42d187776a5479e60a8d as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f1/e4871ad6f67b42d187776a5479e60a8d 2023-02-18 15:01:18,359 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f1/e4871ad6f67b42d187776a5479e60a8d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:18,361 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/.tmp/f2/8fcc4282e79948cf91a9093ac5179df9 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f2/8fcc4282e79948cf91a9093ac5179df9 2023-02-18 15:01:18,367 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f2/8fcc4282e79948cf91a9093ac5179df9, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:18,368 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e2a34af80dd34758100e2f6655c2e29c in 324ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:18,368 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-18 15:01:18,368 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e2a34af80dd34758100e2f6655c2e29c: 2023-02-18 15:01:18,369 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,369 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:18,369 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f1/e4871ad6f67b42d187776a5479e60a8d] hfiles 2023-02-18 15:01:18,369 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f1/e4871ad6f67b42d187776a5479e60a8d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,369 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f2/8fcc4282e79948cf91a9093ac5179df9] hfiles 2023-02-18 15:01:18,369 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f2/8fcc4282e79948cf91a9093ac5179df9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,380 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/.tmp/f2/927c71016e7e4d1995d948256eda770d 2023-02-18 15:01:18,386 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/.tmp/f2/46bcb3c2382a4aa9b9b526901a984a1b 2023-02-18 15:01:18,390 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/.tmp/f1/9e50833b32c94c828aab5f95d687aac7 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f1/9e50833b32c94c828aab5f95d687aac7 2023-02-18 15:01:18,402 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f1/9e50833b32c94c828aab5f95d687aac7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:18,402 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/.tmp/f1/7d9068d9e68549479feb6db13892c0a3 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f1/7d9068d9e68549479feb6db13892c0a3 2023-02-18 15:01:18,403 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/.tmp/f2/927c71016e7e4d1995d948256eda770d as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f2/927c71016e7e4d1995d948256eda770d 2023-02-18 15:01:18,413 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/.tmp/f2/1220b11e9a004090aa47e609f8d0e897 2023-02-18 15:01:18,427 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/.tmp/f2/7685397c39d84f57a674759717357b28 2023-02-18 15:01:18,428 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f2/927c71016e7e4d1995d948256eda770d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:18,428 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f1/7d9068d9e68549479feb6db13892c0a3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:18,430 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d2ca2b9b31116f5f35f780e617081622 in 362ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:18,430 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d2ca2b9b31116f5f35f780e617081622: 2023-02-18 15:01:18,431 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,431 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:18,431 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f1/9e50833b32c94c828aab5f95d687aac7] hfiles 2023-02-18 15:01:18,431 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f1/9e50833b32c94c828aab5f95d687aac7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,431 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f2/927c71016e7e4d1995d948256eda770d] hfiles 2023-02-18 15:01:18,431 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f2/927c71016e7e4d1995d948256eda770d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,430 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/.tmp/f2/46bcb3c2382a4aa9b9b526901a984a1b as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f2/46bcb3c2382a4aa9b9b526901a984a1b 2023-02-18 15:01:18,434 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/.tmp/f1/43387f73e9d144f6997df2bea2c70827 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f1/43387f73e9d144f6997df2bea2c70827 2023-02-18 15:01:18,440 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/.tmp/f1/81818eecc94c4d94b718087a6f6422fe as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f1/81818eecc94c4d94b718087a6f6422fe 2023-02-18 15:01:18,443 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f1/43387f73e9d144f6997df2bea2c70827, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:18,444 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f2/46bcb3c2382a4aa9b9b526901a984a1b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:18,445 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/.tmp/f2/1220b11e9a004090aa47e609f8d0e897 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f2/1220b11e9a004090aa47e609f8d0e897 2023-02-18 15:01:18,447 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f1/81818eecc94c4d94b718087a6f6422fe, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:18,447 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1467c8a0b279ac201d66904269e50919 in 388ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:18,447 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1467c8a0b279ac201d66904269e50919: 2023-02-18 15:01:18,447 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,447 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:18,447 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f1/7d9068d9e68549479feb6db13892c0a3] hfiles 2023-02-18 15:01:18,447 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f1/7d9068d9e68549479feb6db13892c0a3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,447 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f2/46bcb3c2382a4aa9b9b526901a984a1b] hfiles 2023-02-18 15:01:18,447 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f2/46bcb3c2382a4aa9b9b526901a984a1b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,449 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/.tmp/f2/7685397c39d84f57a674759717357b28 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f2/7685397c39d84f57a674759717357b28 2023-02-18 15:01:18,457 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. completed. 2023-02-18 15:01:18,457 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:18,457 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:18,457 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 15:01:18,457 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. started... 2023-02-18 15:01:18,457 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 70b18795206458e1174fc2cdebb02463 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:18,457 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f2/1220b11e9a004090aa47e609f8d0e897, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:18,458 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f2/7685397c39d84f57a674759717357b28, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:18,458 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0dbc5c172d5fc74b7d700b64c781ca9a in 323ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:18,458 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 0dbc5c172d5fc74b7d700b64c781ca9a: 2023-02-18 15:01:18,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:18,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f1/43387f73e9d144f6997df2bea2c70827] hfiles 2023-02-18 15:01:18,459 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e25baff02b43f460f4b436f6ee0282a5 in 400ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:18,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e25baff02b43f460f4b436f6ee0282a5: 2023-02-18 15:01:18,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:18,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f1/81818eecc94c4d94b718087a6f6422fe] hfiles 2023-02-18 15:01:18,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f1/81818eecc94c4d94b718087a6f6422fe for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f2/7685397c39d84f57a674759717357b28] hfiles 2023-02-18 15:01:18,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f2/7685397c39d84f57a674759717357b28 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f1/43387f73e9d144f6997df2bea2c70827 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,460 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f2/1220b11e9a004090aa47e609f8d0e897] hfiles 2023-02-18 15:01:18,460 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f2/1220b11e9a004090aa47e609f8d0e897 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,460 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. completed. 2023-02-18 15:01:18,460 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:18,460 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 15:01:18,491 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. completed. 2023-02-18 15:01:18,491 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:18,491 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. completed. 2023-02-18 15:01:18,492 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:18,492 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 15:01:18,492 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:18,492 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 15:01:18,492 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. started... 2023-02-18 15:01:18,492 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4cae14511ed442b847449e9510f13ebe 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:18,503 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/.tmp/f1/8db24621e2a640b8816358a85dbd1c1d 2023-02-18 15:01:18,515 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/.tmp/f1/5463d79ff188416dbe3b111c9285c611 2023-02-18 15:01:18,560 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/.tmp/f2/16abf18e0a044cffa58e3e50c8cf6a04 2023-02-18 15:01:18,563 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/.tmp/f2/47bd075e9eb24472a0b1104c9251df4d 2023-02-18 15:01:18,567 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/.tmp/f1/5463d79ff188416dbe3b111c9285c611 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f1/5463d79ff188416dbe3b111c9285c611 2023-02-18 15:01:18,570 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/.tmp/f1/8db24621e2a640b8816358a85dbd1c1d as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f1/8db24621e2a640b8816358a85dbd1c1d 2023-02-18 15:01:18,574 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f1/5463d79ff188416dbe3b111c9285c611, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:18,575 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/.tmp/f2/16abf18e0a044cffa58e3e50c8cf6a04 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f2/16abf18e0a044cffa58e3e50c8cf6a04 2023-02-18 15:01:18,576 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f1/8db24621e2a640b8816358a85dbd1c1d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:18,577 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/.tmp/f2/47bd075e9eb24472a0b1104c9251df4d as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f2/47bd075e9eb24472a0b1104c9251df4d 2023-02-18 15:01:18,583 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:18,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:18,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:18,585 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-18 15:01:18,586 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f2/47bd075e9eb24472a0b1104c9251df4d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:18,586 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f2/16abf18e0a044cffa58e3e50c8cf6a04, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:18,587 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 70b18795206458e1174fc2cdebb02463 in 130ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:18,587 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 70b18795206458e1174fc2cdebb02463: 2023-02-18 15:01:18,587 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4cae14511ed442b847449e9510f13ebe in 95ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:18,587 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4cae14511ed442b847449e9510f13ebe: 2023-02-18 15:01:18,587 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,587 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:18,587 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,587 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f1/8db24621e2a640b8816358a85dbd1c1d] hfiles 2023-02-18 15:01:18,588 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:18,588 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f1/8db24621e2a640b8816358a85dbd1c1d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,588 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f1/5463d79ff188416dbe3b111c9285c611] hfiles 2023-02-18 15:01:18,588 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f2/47bd075e9eb24472a0b1104c9251df4d] hfiles 2023-02-18 15:01:18,588 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f2/47bd075e9eb24472a0b1104c9251df4d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,588 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f1/5463d79ff188416dbe3b111c9285c611 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,588 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f2/16abf18e0a044cffa58e3e50c8cf6a04] hfiles 2023-02-18 15:01:18,588 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f2/16abf18e0a044cffa58e3e50c8cf6a04 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:18,610 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. completed. 2023-02-18 15:01:18,611 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:18,611 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 15:01:18,613 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. completed. 2023-02-18 15:01:18,613 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:18,613 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 15:01:18,763 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/.tmp/f1/deddce61f4f04df6aed8949676dd6e88 2023-02-18 15:01:18,778 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/.tmp/f2/336e02c09721474cb40a155b01feb0e6 2023-02-18 15:01:18,785 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/.tmp/f1/deddce61f4f04df6aed8949676dd6e88 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f1/deddce61f4f04df6aed8949676dd6e88 2023-02-18 15:01:18,789 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f1/deddce61f4f04df6aed8949676dd6e88, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:18,790 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/.tmp/f2/336e02c09721474cb40a155b01feb0e6 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f2/336e02c09721474cb40a155b01feb0e6 2023-02-18 15:01:19,005 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. completed. 2023-02-18 15:01:19,005 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 15:01:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 15:01:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,007 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-18 15:01:19,007 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,42421,1676732475196' in zk 2023-02-18 15:01:19,011 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f2/336e02c09721474cb40a155b01feb0e6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:19,011 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,011 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-18 15:01:19,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:19,011 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:19,012 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-18 15:01:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,014 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3960aa24086f70e10a20912542151ecc in 734ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:19,014 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3960aa24086f70e10a20912542151ecc: 2023-02-18 15:01:19,014 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,014 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:19,014 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f1/deddce61f4f04df6aed8949676dd6e88] hfiles 2023-02-18 15:01:19,014 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f1/deddce61f4f04df6aed8949676dd6e88 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,014 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f2/336e02c09721474cb40a155b01feb0e6] hfiles 2023-02-18 15:01:19,014 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f2/336e02c09721474cb40a155b01feb0e6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,42421,1676732475196': 2023-02-18 15:01:19,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42421,1676732475196' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 15:01:19,023 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. completed. 2023-02-18 15:01:19,023 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:19,023 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 15:01:19,023 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 15:01:19,023 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,023 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-18 15:01:19,023 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,37135,1676732475162' in zk 2023-02-18 15:01:19,025 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-18 15:01:19,025 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,025 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:19,025 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-18 15:01:19,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:19,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:19,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:19,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,37135,1676732475162': 2023-02-18 15:01:19,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37135,1676732475162' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 15:01:19,030 INFO [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-18 15:01:19,030 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:19,030 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:19,030 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,030 INFO [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 15:01:19,032 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,032 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:19,032 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:19,032 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,032 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:19,032 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:19,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,033 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:19,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,035 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:19,035 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,042 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,042 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,042 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:19,042 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:19,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:19,042 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:19,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:19,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,042 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,042 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,042 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:19,042 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,042 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:19,042 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:19,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:19,042 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:19,043 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:19,044 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,085 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:19,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:19,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:19,089 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-18 15:01:19,105 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-18 15:01:19,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,105 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:19,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676732477977Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676732479042 (+1065 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676732479043 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676732479057 (+14 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676732479066 (+9 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676732479105 (+39 ms) 2023-02-18 15:01:19,108 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 15:01:19,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1300 sec 2023-02-18 15:01:20,089 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:20,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:20,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 15:01:20,092 INFO [Listener at localhost/46609] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 15:01:20,097 INFO [Listener at localhost/46609] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 15:01:20,106 INFO [Listener at localhost/46609] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 15:01:20,151 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42421] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:20,151 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37135] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:20,238 INFO [Listener at localhost/46609] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 15:01:20,245 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 15:01:20,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-18 15:01:20,249 INFO [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-18 15:01:20,249 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:20,250 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-18 15:01:20,250 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-18 15:01:20,251 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,251 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:20,252 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:20,252 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:20,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:20,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:20,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:20,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:20,253 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:20,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:20,254 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,254 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:20,254 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,254 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:20,255 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 15:01:20,255 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 15:01:20,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 15:01:20,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 15:01:20,255 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 15:01:20,255 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 15:01:20,255 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:20,255 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:20,256 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 15:01:20,257 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 15:01:20,257 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:20,257 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. started... 2023-02-18 15:01:20,258 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1467c8a0b279ac201d66904269e50919 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:20,264 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:20,265 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. started... 2023-02-18 15:01:20,265 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:20,265 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. started... 2023-02-18 15:01:20,265 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e2a34af80dd34758100e2f6655c2e29c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 15:01:20,265 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b98a94ebff502da1d4174cd4ce4e5ccf: 2023-02-18 15:01:20,265 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:20,265 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:20,265 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. started... 2023-02-18 15:01:20,265 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e25baff02b43f460f4b436f6ee0282a5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:20,267 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:20,267 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. started... 2023-02-18 15:01:20,267 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d2ca2b9b31116f5f35f780e617081622 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 15:01:20,268 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 15:01:20,268 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:20,268 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. started... 2023-02-18 15:01:20,268 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 15:01:20,269 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:20,269 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 15:01:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 15:01:20,270 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. started... 2023-02-18 15:01:20,270 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 90008c5ea3c222e0e54e8e39c9dfff9e: 2023-02-18 15:01:20,270 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:20,271 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:20,271 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. started... 2023-02-18 15:01:20,270 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3960aa24086f70e10a20912542151ecc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:20,271 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 0dbc5c172d5fc74b7d700b64c781ca9a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 15:01:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 15:01:20,332 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/.tmp/f1/f1efd898472d4f35a522dd91c2fe1da8 2023-02-18 15:01:20,355 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/.tmp/f1/b749859d5df641588b4c42bd4424a1ba 2023-02-18 15:01:20,365 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/.tmp/f1/a8d43f69bd004ada88c2cde4a7010998 2023-02-18 15:01:20,370 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/.tmp/f1/d8cb7c4722c442fabad9bc1c64ead61c 2023-02-18 15:01:20,373 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/.tmp/f1/1d0c5057080142d5a96b0885e4004690 2023-02-18 15:01:20,404 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/.tmp/f2/43a78d46b71d49aea8fea00f989bd463 2023-02-18 15:01:20,413 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/.tmp/f1/933b0cf9c197454cb847000c00f79550 2023-02-18 15:01:20,415 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/.tmp/f2/4f706a4ac74741fb84a4c964a6bf32aa 2023-02-18 15:01:20,425 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/.tmp/f1/b749859d5df641588b4c42bd4424a1ba as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f1/b749859d5df641588b4c42bd4424a1ba 2023-02-18 15:01:20,429 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/.tmp/f2/cb63aeb49e424961869f9bbfa9bb979f 2023-02-18 15:01:20,432 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/.tmp/f1/f1efd898472d4f35a522dd91c2fe1da8 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f1/f1efd898472d4f35a522dd91c2fe1da8 2023-02-18 15:01:20,432 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f1/b749859d5df641588b4c42bd4424a1ba, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,434 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/.tmp/f2/43a78d46b71d49aea8fea00f989bd463 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f2/43a78d46b71d49aea8fea00f989bd463 2023-02-18 15:01:20,435 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/.tmp/f1/a8d43f69bd004ada88c2cde4a7010998 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f1/a8d43f69bd004ada88c2cde4a7010998 2023-02-18 15:01:20,438 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/.tmp/f2/307939b3c43a4146b0c3fd43c37e2de7 2023-02-18 15:01:20,441 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f1/f1efd898472d4f35a522dd91c2fe1da8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,442 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/.tmp/f2/4f706a4ac74741fb84a4c964a6bf32aa as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f2/4f706a4ac74741fb84a4c964a6bf32aa 2023-02-18 15:01:20,443 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f1/a8d43f69bd004ada88c2cde4a7010998, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,443 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f2/43a78d46b71d49aea8fea00f989bd463, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,444 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3960aa24086f70e10a20912542151ecc in 174ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:20,444 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3960aa24086f70e10a20912542151ecc: 2023-02-18 15:01:20,444 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:20,444 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/.tmp/f2/cb63aeb49e424961869f9bbfa9bb979f as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f2/cb63aeb49e424961869f9bbfa9bb979f 2023-02-18 15:01:20,446 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/.tmp/f2/b32438c45c8448c1b81e1687d395e8bc 2023-02-18 15:01:20,448 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:20,448 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. started... 2023-02-18 15:01:20,448 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 70b18795206458e1174fc2cdebb02463 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:20,448 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 15:01:20,456 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/.tmp/f1/d8cb7c4722c442fabad9bc1c64ead61c as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f1/d8cb7c4722c442fabad9bc1c64ead61c 2023-02-18 15:01:20,458 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f2/cb63aeb49e424961869f9bbfa9bb979f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,458 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f2/4f706a4ac74741fb84a4c964a6bf32aa, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,459 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e25baff02b43f460f4b436f6ee0282a5 in 194ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:20,459 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1467c8a0b279ac201d66904269e50919 in 201ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:20,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e25baff02b43f460f4b436f6ee0282a5: 2023-02-18 15:01:20,459 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1467c8a0b279ac201d66904269e50919: 2023-02-18 15:01:20,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:20,459 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:20,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:20,459 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 15:01:20,459 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. started... 2023-02-18 15:01:20,459 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 15:01:20,460 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4cae14511ed442b847449e9510f13ebe 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:20,461 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/.tmp/f2/00569cf18c814338841ace4cd59b325b 2023-02-18 15:01:20,463 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f1/d8cb7c4722c442fabad9bc1c64ead61c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:20,464 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/.tmp/f2/307939b3c43a4146b0c3fd43c37e2de7 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f2/307939b3c43a4146b0c3fd43c37e2de7 2023-02-18 15:01:20,465 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/.tmp/f1/1d0c5057080142d5a96b0885e4004690 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f1/1d0c5057080142d5a96b0885e4004690 2023-02-18 15:01:20,468 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/.tmp/f1/933b0cf9c197454cb847000c00f79550 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f1/933b0cf9c197454cb847000c00f79550 2023-02-18 15:01:20,471 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f2/307939b3c43a4146b0c3fd43c37e2de7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:20,471 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f1/1d0c5057080142d5a96b0885e4004690, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:20,473 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e2a34af80dd34758100e2f6655c2e29c in 207ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:20,473 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e2a34af80dd34758100e2f6655c2e29c: 2023-02-18 15:01:20,473 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:20,473 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 15:01:20,474 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/.tmp/f2/b32438c45c8448c1b81e1687d395e8bc as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f2/b32438c45c8448c1b81e1687d395e8bc 2023-02-18 15:01:20,480 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f1/933b0cf9c197454cb847000c00f79550, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,481 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/.tmp/f2/00569cf18c814338841ace4cd59b325b as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f2/00569cf18c814338841ace4cd59b325b 2023-02-18 15:01:20,485 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f2/b32438c45c8448c1b81e1687d395e8bc, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:20,486 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d2ca2b9b31116f5f35f780e617081622 in 219ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:20,486 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d2ca2b9b31116f5f35f780e617081622: 2023-02-18 15:01:20,486 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:20,487 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 15:01:20,504 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/.tmp/f1/4b8afb5b671f4f4086501849217b29cf 2023-02-18 15:01:20,504 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f2/00569cf18c814338841ace4cd59b325b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,504 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/.tmp/f1/d23a14cbce7646b2ae4beb06da55f828 2023-02-18 15:01:20,505 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0dbc5c172d5fc74b7d700b64c781ca9a in 234ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:20,505 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0dbc5c172d5fc74b7d700b64c781ca9a: 2023-02-18 15:01:20,505 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:20,505 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 15:01:20,523 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/.tmp/f2/c6d72614ef0f48558ac19dcd200c6c35 2023-02-18 15:01:20,534 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/.tmp/f1/d23a14cbce7646b2ae4beb06da55f828 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f1/d23a14cbce7646b2ae4beb06da55f828 2023-02-18 15:01:20,540 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f1/d23a14cbce7646b2ae4beb06da55f828, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,541 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/.tmp/f2/c6d72614ef0f48558ac19dcd200c6c35 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f2/c6d72614ef0f48558ac19dcd200c6c35 2023-02-18 15:01:20,547 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f2/c6d72614ef0f48558ac19dcd200c6c35, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,548 INFO [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4cae14511ed442b847449e9510f13ebe in 88ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:20,548 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4cae14511ed442b847449e9510f13ebe: 2023-02-18 15:01:20,548 DEBUG [rs(jenkins-hbase4.apache.org,42421,1676732475196)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:20,548 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 15:01:20,548 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 15:01:20,548 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,548 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 15:01:20,548 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42421,1676732475196' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 15:01:20,550 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,550 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:20,550 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,550 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:20,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42421,1676732475196' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 15:01:20,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3345a1f1[Count = 1] remaining members to acquire global barrier 2023-02-18 15:01:20,926 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/.tmp/f2/eb216cee07b94053b985b1e2c4a5b229 2023-02-18 15:01:20,931 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/.tmp/f1/4b8afb5b671f4f4086501849217b29cf as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f1/4b8afb5b671f4f4086501849217b29cf 2023-02-18 15:01:20,937 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f1/4b8afb5b671f4f4086501849217b29cf, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,937 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/.tmp/f2/eb216cee07b94053b985b1e2c4a5b229 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f2/eb216cee07b94053b985b1e2c4a5b229 2023-02-18 15:01:20,943 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f2/eb216cee07b94053b985b1e2c4a5b229, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:20,944 INFO [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 70b18795206458e1174fc2cdebb02463 in 496ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:20,944 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 70b18795206458e1174fc2cdebb02463: 2023-02-18 15:01:20,944 DEBUG [rs(jenkins-hbase4.apache.org,37135,1676732475162)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:20,944 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 15:01:20,944 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 15:01:20,944 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,944 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 15:01:20,944 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37135,1676732475162' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 15:01:20,946 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,946 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:20,946 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,946 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:20,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37135,1676732475162' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 15:01:20,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3345a1f1[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:20,948 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-18 15:01:20,948 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,951 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,951 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,951 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 15:01:20,951 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 15:01:20,951 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37135,1676732475162' in zk 2023-02-18 15:01:20,951 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,952 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,952 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:20,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 15:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 15:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42421,1676732475196' in zk 2023-02-18 15:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 15:01:20,953 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:20,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:20,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:20,953 DEBUG [member: 'jenkins-hbase4.apache.org,37135,1676732475162' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 15:01:20,955 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 15:01:20,955 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:20,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:20,955 DEBUG [member: 'jenkins-hbase4.apache.org,42421,1676732475196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 15:01:20,955 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:20,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,37135,1676732475162': 2023-02-18 15:01:20,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37135,1676732475162' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-18 15:01:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42421,1676732475196': 2023-02-18 15:01:20,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42421,1676732475196' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-18 15:01:20,961 INFO [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-18 15:01:20,961 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:20,961 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:20,961 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-18 15:01:20,961 INFO [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 15:01:20,962 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,962 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,963 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,963 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:20,963 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,963 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:20,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:20,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:20,964 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,966 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:20,966 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,969 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,969 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:20,969 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:20,969 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:20,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:20,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:20,969 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,970 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-18 15:01:20,970 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 15:01:20,969 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:20,970 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:20,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:20,970 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:20,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:20,970 DEBUG [(jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:20,970 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:20,970 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:20,971 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:20,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:20,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:20,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:20,971 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:20,971 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:20,971 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:20,971 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 15:01:21,072 DEBUG [Listener at localhost/46609] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 15:01:21,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39403] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 15:01:21,073 INFO [Listener at localhost/46609] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 15:01:21,073 DEBUG [Listener at localhost/46609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e065ace to 127.0.0.1:59779 2023-02-18 15:01:21,074 DEBUG [Listener at localhost/46609] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:21,074 DEBUG [Listener at localhost/46609] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 15:01:21,074 DEBUG [Listener at localhost/46609] util.JVMClusterUtil(257): Found active master hash=1093652187, stopped=false 2023-02-18 15:01:21,074 INFO [Listener at localhost/46609] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39403,1676732475097 2023-02-18 15:01:21,075 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:21,075 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:21,075 INFO [Listener at localhost/46609] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 15:01:21,075 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:21,075 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:21,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:21,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:21,077 DEBUG [Listener at localhost/46609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x060f8785 to 127.0.0.1:59779 2023-02-18 15:01:21,077 DEBUG [Listener at localhost/46609] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:21,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:21,077 INFO [Listener at localhost/46609] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37135,1676732475162' ***** 2023-02-18 15:01:21,077 INFO [Listener at localhost/46609] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:21,077 INFO [Listener at localhost/46609] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42421,1676732475196' ***** 2023-02-18 15:01:21,077 INFO [Listener at localhost/46609] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:21,077 INFO [RS:0;jenkins-hbase4:37135] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:21,078 INFO [RS:1;jenkins-hbase4:42421] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:21,078 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:21,078 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:21,079 INFO [RS:1;jenkins-hbase4:42421] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:21,078 INFO [RS:0;jenkins-hbase4:37135] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:21,080 INFO [RS:1;jenkins-hbase4:42421] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:21,080 INFO [RS:0;jenkins-hbase4:37135] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:21,080 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(3304): Received CLOSE for e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:21,080 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(3304): Received CLOSE for 1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:21,080 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(3304): Received CLOSE for e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:21,080 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(3304): Received CLOSE for b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:21,080 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(3304): Received CLOSE for 90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:21,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1467c8a0b279ac201d66904269e50919, disabling compactions & flushes 2023-02-18 15:01:21,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e2a34af80dd34758100e2f6655c2e29c, disabling compactions & flushes 2023-02-18 15:01:21,080 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(3304): Received CLOSE for d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:21,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:21,080 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(3304): Received CLOSE for 76dfa65294103b8b3e6d208483cfe0e4 2023-02-18 15:01:21,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:21,080 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(3304): Received CLOSE for 0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:21,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:21,081 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(3304): Received CLOSE for 3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:21,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. after waiting 0 ms 2023-02-18 15:01:21,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:21,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:21,081 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(3304): Received CLOSE for 70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:21,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. after waiting 0 ms 2023-02-18 15:01:21,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:21,081 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(3304): Received CLOSE for 4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:21,081 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:21,081 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:21,081 DEBUG [RS:0;jenkins-hbase4:37135] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15820fde to 127.0.0.1:59779 2023-02-18 15:01:21,081 DEBUG [RS:1;jenkins-hbase4:42421] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42a20910 to 127.0.0.1:59779 2023-02-18 15:01:21,081 DEBUG [RS:0;jenkins-hbase4:37135] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:21,081 DEBUG [RS:1;jenkins-hbase4:42421] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:21,081 INFO [RS:0;jenkins-hbase4:37135] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:21,081 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-18 15:01:21,081 INFO [RS:0;jenkins-hbase4:37135] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:21,081 DEBUG [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1479): Online Regions={e2a34af80dd34758100e2f6655c2e29c=testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c., e25baff02b43f460f4b436f6ee0282a5=testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5., 90008c5ea3c222e0e54e8e39c9dfff9e=testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e., 0dbc5c172d5fc74b7d700b64c781ca9a=testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a., 4cae14511ed442b847449e9510f13ebe=testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.} 2023-02-18 15:01:21,083 INFO [RS:0;jenkins-hbase4:37135] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:21,085 DEBUG [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1505): Waiting on 0dbc5c172d5fc74b7d700b64c781ca9a, 4cae14511ed442b847449e9510f13ebe, 90008c5ea3c222e0e54e8e39c9dfff9e, e25baff02b43f460f4b436f6ee0282a5, e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:21,085 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 15:01:21,086 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-18 15:01:21,088 DEBUG [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1479): Online Regions={1467c8a0b279ac201d66904269e50919=testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919., b98a94ebff502da1d4174cd4ce4e5ccf=testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf., 1588230740=hbase:meta,,1.1588230740, d2ca2b9b31116f5f35f780e617081622=testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622., 76dfa65294103b8b3e6d208483cfe0e4=hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4., 3960aa24086f70e10a20912542151ecc=testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc., 70b18795206458e1174fc2cdebb02463=testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.} 2023-02-18 15:01:21,088 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:21,089 DEBUG [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1505): Waiting on 1467c8a0b279ac201d66904269e50919, 1588230740, 3960aa24086f70e10a20912542151ecc, 70b18795206458e1174fc2cdebb02463, 76dfa65294103b8b3e6d208483cfe0e4, b98a94ebff502da1d4174cd4ce4e5ccf, d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:21,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:21,091 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:21,091 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:21,091 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:21,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-18 15:01:21,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:21,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:21,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1467c8a0b279ac201d66904269e50919: 2023-02-18 15:01:21,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:21,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b98a94ebff502da1d4174cd4ce4e5ccf, disabling compactions & flushes 2023-02-18 15:01:21,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:21,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:21,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. after waiting 0 ms 2023-02-18 15:01:21,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:21,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:21,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:21,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e2a34af80dd34758100e2f6655c2e29c: 2023-02-18 15:01:21,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:21,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e25baff02b43f460f4b436f6ee0282a5, disabling compactions & flushes 2023-02-18 15:01:21,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:21,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:21,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. after waiting 0 ms 2023-02-18 15:01:21,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:21,105 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:21,106 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:21,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 15:01:21,109 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/.tmp/info/3d635efbc8f1434797d3af4b498fd053 2023-02-18 15:01:21,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:21,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b98a94ebff502da1d4174cd4ce4e5ccf: 2023-02-18 15:01:21,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:21,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d2ca2b9b31116f5f35f780e617081622, disabling compactions & flushes 2023-02-18 15:01:21,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:21,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:21,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. after waiting 0 ms 2023-02-18 15:01:21,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:21,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:21,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:21,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e25baff02b43f460f4b436f6ee0282a5: 2023-02-18 15:01:21,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:21,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 90008c5ea3c222e0e54e8e39c9dfff9e, disabling compactions & flushes 2023-02-18 15:01:21,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:21,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:21,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. after waiting 0 ms 2023-02-18 15:01:21,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:21,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:21,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:21,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d2ca2b9b31116f5f35f780e617081622: 2023-02-18 15:01:21,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:21,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 76dfa65294103b8b3e6d208483cfe0e4, disabling compactions & flushes 2023-02-18 15:01:21,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:21,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:21,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. after waiting 0 ms 2023-02-18 15:01:21,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:21,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 76dfa65294103b8b3e6d208483cfe0e4 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 15:01:21,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 15:01:21,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:21,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 90008c5ea3c222e0e54e8e39c9dfff9e: 2023-02-18 15:01:21,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:21,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0dbc5c172d5fc74b7d700b64c781ca9a, disabling compactions & flushes 2023-02-18 15:01:21,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:21,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:21,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. after waiting 0 ms 2023-02-18 15:01:21,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:21,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:21,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:21,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0dbc5c172d5fc74b7d700b64c781ca9a: 2023-02-18 15:01:21,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:21,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4cae14511ed442b847449e9510f13ebe, disabling compactions & flushes 2023-02-18 15:01:21,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:21,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:21,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. after waiting 0 ms 2023-02-18 15:01:21,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:21,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4/.tmp/info/4af8f7b5afa446b4a3fd4c0079454be7 2023-02-18 15:01:21,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:21,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:21,159 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/.tmp/table/d03b2736df9e4b90950ffbf0fb20d764 2023-02-18 15:01:21,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4cae14511ed442b847449e9510f13ebe: 2023-02-18 15:01:21,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:21,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4/.tmp/info/4af8f7b5afa446b4a3fd4c0079454be7 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4/info/4af8f7b5afa446b4a3fd4c0079454be7 2023-02-18 15:01:21,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4/info/4af8f7b5afa446b4a3fd4c0079454be7, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 15:01:21,164 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/.tmp/info/3d635efbc8f1434797d3af4b498fd053 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/info/3d635efbc8f1434797d3af4b498fd053 2023-02-18 15:01:21,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 76dfa65294103b8b3e6d208483cfe0e4 in 39ms, sequenceid=6, compaction requested=false 2023-02-18 15:01:21,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-18 15:01:21,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/namespace/76dfa65294103b8b3e6d208483cfe0e4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 15:01:21,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/info/3d635efbc8f1434797d3af4b498fd053, entries=110, sequenceid=32, filesize=18.7 K 2023-02-18 15:01:21,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:21,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 76dfa65294103b8b3e6d208483cfe0e4: 2023-02-18 15:01:21,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676732475916.76dfa65294103b8b3e6d208483cfe0e4. 2023-02-18 15:01:21,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3960aa24086f70e10a20912542151ecc, disabling compactions & flushes 2023-02-18 15:01:21,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:21,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:21,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. after waiting 0 ms 2023-02-18 15:01:21,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:21,172 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/.tmp/table/d03b2736df9e4b90950ffbf0fb20d764 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/table/d03b2736df9e4b90950ffbf0fb20d764 2023-02-18 15:01:21,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:21,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:21,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3960aa24086f70e10a20912542151ecc: 2023-02-18 15:01:21,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:21,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 70b18795206458e1174fc2cdebb02463, disabling compactions & flushes 2023-02-18 15:01:21,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:21,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:21,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. after waiting 0 ms 2023-02-18 15:01:21,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:21,179 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/table/d03b2736df9e4b90950ffbf0fb20d764, entries=4, sequenceid=32, filesize=4.8 K 2023-02-18 15:01:21,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 89ms, sequenceid=32, compaction requested=false 2023-02-18 15:01:21,180 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-18 15:01:21,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:21,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:21,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 70b18795206458e1174fc2cdebb02463: 2023-02-18 15:01:21,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:21,185 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-18 15:01:21,185 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 15:01:21,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:21,185 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:21,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:21,285 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42421,1676732475196; all regions closed. 2023-02-18 15:01:21,290 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37135,1676732475162; all regions closed. 2023-02-18 15:01:21,291 DEBUG [RS:1;jenkins-hbase4:42421] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/oldWALs 2023-02-18 15:01:21,291 INFO [RS:1;jenkins-hbase4:42421] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42421%2C1676732475196:(num 1676732476618) 2023-02-18 15:01:21,292 DEBUG [RS:1;jenkins-hbase4:42421] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:21,292 INFO [RS:1;jenkins-hbase4:42421] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:21,292 INFO [RS:1;jenkins-hbase4:42421] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:21,292 INFO [RS:1;jenkins-hbase4:42421] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:21,292 INFO [RS:1;jenkins-hbase4:42421] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:21,292 INFO [RS:1;jenkins-hbase4:42421] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:21,292 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:21,293 INFO [RS:1;jenkins-hbase4:42421] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42421 2023-02-18 15:01:21,296 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:21,296 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42421,1676732475196 2023-02-18 15:01:21,296 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:21,296 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:21,296 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:21,296 ERROR [Listener at localhost/46609-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6f640841 rejected from java.util.concurrent.ThreadPoolExecutor@6b5b8175[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:21,297 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42421,1676732475196] 2023-02-18 15:01:21,297 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42421,1676732475196; numProcessing=1 2023-02-18 15:01:21,297 DEBUG [RS:0;jenkins-hbase4:37135] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/oldWALs 2023-02-18 15:01:21,297 INFO [RS:0;jenkins-hbase4:37135] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37135%2C1676732475162.meta:.meta(num 1676732475832) 2023-02-18 15:01:21,300 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42421,1676732475196 already deleted, retry=false 2023-02-18 15:01:21,300 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42421,1676732475196 expired; onlineServers=1 2023-02-18 15:01:21,302 DEBUG [RS:0;jenkins-hbase4:37135] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/oldWALs 2023-02-18 15:01:21,302 INFO [RS:0;jenkins-hbase4:37135] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37135%2C1676732475162:(num 1676732476300) 2023-02-18 15:01:21,302 DEBUG [RS:0;jenkins-hbase4:37135] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:21,302 INFO [RS:0;jenkins-hbase4:37135] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:21,303 INFO [RS:0;jenkins-hbase4:37135] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:21,303 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:21,303 INFO [RS:0;jenkins-hbase4:37135] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37135 2023-02-18 15:01:21,306 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37135,1676732475162 2023-02-18 15:01:21,306 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:21,306 ERROR [Listener at localhost/46609-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@417d53b6 rejected from java.util.concurrent.ThreadPoolExecutor@4542cf41[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:21,307 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37135,1676732475162] 2023-02-18 15:01:21,307 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37135,1676732475162; numProcessing=2 2023-02-18 15:01:21,308 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37135,1676732475162 already deleted, retry=false 2023-02-18 15:01:21,308 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37135,1676732475162 expired; onlineServers=0 2023-02-18 15:01:21,308 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39403,1676732475097' ***** 2023-02-18 15:01:21,308 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 15:01:21,309 DEBUG [M:0;jenkins-hbase4:39403] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12c4e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:21,309 INFO [M:0;jenkins-hbase4:39403] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39403,1676732475097 2023-02-18 15:01:21,309 INFO [M:0;jenkins-hbase4:39403] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39403,1676732475097; all regions closed. 2023-02-18 15:01:21,309 DEBUG [M:0;jenkins-hbase4:39403] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:21,309 DEBUG [M:0;jenkins-hbase4:39403] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 15:01:21,309 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 15:01:21,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732475453] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732475453,5,FailOnTimeoutGroup] 2023-02-18 15:01:21,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732475452] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732475452,5,FailOnTimeoutGroup] 2023-02-18 15:01:21,309 DEBUG [M:0;jenkins-hbase4:39403] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 15:01:21,311 INFO [M:0;jenkins-hbase4:39403] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 15:01:21,311 INFO [M:0;jenkins-hbase4:39403] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 15:01:21,311 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:21,311 INFO [M:0;jenkins-hbase4:39403] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 15:01:21,311 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:21,312 DEBUG [M:0;jenkins-hbase4:39403] master.HMaster(1512): Stopping service threads 2023-02-18 15:01:21,312 INFO [M:0;jenkins-hbase4:39403] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 15:01:21,312 ERROR [M:0;jenkins-hbase4:39403] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 15:01:21,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:21,312 INFO [M:0;jenkins-hbase4:39403] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 15:01:21,312 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 15:01:21,313 DEBUG [M:0;jenkins-hbase4:39403] zookeeper.ZKUtil(398): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 15:01:21,313 WARN [M:0;jenkins-hbase4:39403] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 15:01:21,313 INFO [M:0;jenkins-hbase4:39403] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 15:01:21,313 INFO [M:0;jenkins-hbase4:39403] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 15:01:21,313 DEBUG [M:0;jenkins-hbase4:39403] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:21,313 INFO [M:0;jenkins-hbase4:39403] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:21,313 DEBUG [M:0;jenkins-hbase4:39403] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:21,313 DEBUG [M:0;jenkins-hbase4:39403] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:21,313 DEBUG [M:0;jenkins-hbase4:39403] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:21,313 INFO [M:0;jenkins-hbase4:39403] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.95 KB heapSize=120.63 KB 2023-02-18 15:01:21,325 INFO [M:0;jenkins-hbase4:39403] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.95 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/edd09ad79c1e489eb9ad8e6ff47a2136 2023-02-18 15:01:21,330 DEBUG [M:0;jenkins-hbase4:39403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/edd09ad79c1e489eb9ad8e6ff47a2136 as hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/edd09ad79c1e489eb9ad8e6ff47a2136 2023-02-18 15:01:21,335 INFO [M:0;jenkins-hbase4:39403] regionserver.HStore(1080): Added hdfs://localhost:32933/user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/edd09ad79c1e489eb9ad8e6ff47a2136, entries=31, sequenceid=218, filesize=9.0 K 2023-02-18 15:01:21,336 INFO [M:0;jenkins-hbase4:39403] regionserver.HRegion(2947): Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=218, compaction requested=false 2023-02-18 15:01:21,336 INFO [M:0;jenkins-hbase4:39403] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:21,336 DEBUG [M:0;jenkins-hbase4:39403] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:21,341 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/8d5dbfec-dfa5-211c-ecf1-521aef5977aa/MasterData/WALs/jenkins-hbase4.apache.org,39403,1676732475097/jenkins-hbase4.apache.org%2C39403%2C1676732475097.1676732475312 not finished, retry = 0 2023-02-18 15:01:21,442 INFO [M:0;jenkins-hbase4:39403] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 15:01:21,442 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:21,443 INFO [M:0;jenkins-hbase4:39403] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39403 2023-02-18 15:01:21,447 DEBUG [M:0;jenkins-hbase4:39403] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39403,1676732475097 already deleted, retry=false 2023-02-18 15:01:21,576 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:21,576 INFO [M:0;jenkins-hbase4:39403] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39403,1676732475097; zookeeper connection closed. 2023-02-18 15:01:21,576 ERROR [Listener at localhost/46609-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@154c4dd3 rejected from java.util.concurrent.ThreadPoolExecutor@1173dba2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:21,577 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): master:39403-0x10067f3107c0000, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:21,577 ERROR [Listener at localhost/46609-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@123a7094 rejected from java.util.concurrent.ThreadPoolExecutor@1173dba2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:21,676 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:21,676 INFO [RS:0;jenkins-hbase4:37135] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37135,1676732475162; zookeeper connection closed. 2023-02-18 15:01:21,676 ERROR [Listener at localhost/46609-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a41fe98 rejected from java.util.concurrent.ThreadPoolExecutor@4542cf41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:21,676 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:37135-0x10067f3107c0001, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:21,676 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@43ea33] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@43ea33 2023-02-18 15:01:21,676 ERROR [Listener at localhost/46609-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62610732 rejected from java.util.concurrent.ThreadPoolExecutor@4542cf41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:21,776 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:21,776 INFO [RS:1;jenkins-hbase4:42421] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42421,1676732475196; zookeeper connection closed. 2023-02-18 15:01:21,776 ERROR [Listener at localhost/46609-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50543676 rejected from java.util.concurrent.ThreadPoolExecutor@6b5b8175[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:21,777 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6e07a604] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6e07a604 2023-02-18 15:01:21,777 DEBUG [Listener at localhost/46609-EventThread] zookeeper.ZKWatcher(600): regionserver:42421-0x10067f3107c0002, quorum=127.0.0.1:59779, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:21,777 ERROR [Listener at localhost/46609-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@28da6086 rejected from java.util.concurrent.ThreadPoolExecutor@6b5b8175[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:21,777 INFO [Listener at localhost/46609] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 15:01:21,864 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/hadoop-6571723042845044643.jar 2023-02-18 15:01:21,868 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676732477948 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:21,869 DEBUG [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce 2023-02-18 15:01:21,869 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(239): region to add: 1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:21,869 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(239): region to add: e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:21,869 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(239): region to add: e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:21,869 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(239): region to add: b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(239): region to add: d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(239): region to add: 90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(239): region to add: 3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(239): region to add: 70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(239): region to add: 0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(239): region to add: 4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(585): clone region=1467c8a0b279ac201d66904269e50919 as 1467c8a0b279ac201d66904269e50919 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(585): clone region=e2a34af80dd34758100e2f6655c2e29c as e2a34af80dd34758100e2f6655c2e29c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(585): clone region=e25baff02b43f460f4b436f6ee0282a5 as e25baff02b43f460f4b436f6ee0282a5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(585): clone region=b98a94ebff502da1d4174cd4ce4e5ccf as b98a94ebff502da1d4174cd4ce4e5ccf in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(585): clone region=d2ca2b9b31116f5f35f780e617081622 as d2ca2b9b31116f5f35f780e617081622 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(585): clone region=90008c5ea3c222e0e54e8e39c9dfff9e as 90008c5ea3c222e0e54e8e39c9dfff9e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(585): clone region=3960aa24086f70e10a20912542151ecc as 3960aa24086f70e10a20912542151ecc in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(585): clone region=70b18795206458e1174fc2cdebb02463 as 70b18795206458e1174fc2cdebb02463 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(585): clone region=0dbc5c172d5fc74b7d700b64c781ca9a as 0dbc5c172d5fc74b7d700b64c781ca9a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:21,870 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(585): clone region=4cae14511ed442b847449e9510f13ebe as 4cae14511ed442b847449e9510f13ebe in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 15:01:21,872 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => b98a94ebff502da1d4174cd4ce4e5ccf, NAME => 'testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:21,872 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => e2a34af80dd34758100e2f6655c2e29c, NAME => 'testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:21,872 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 90008c5ea3c222e0e54e8e39c9dfff9e, NAME => 'testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:21,872 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => e25baff02b43f460f4b436f6ee0282a5, NAME => 'testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:21,872 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d2ca2b9b31116f5f35f780e617081622, NAME => 'testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:21,873 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 70b18795206458e1174fc2cdebb02463, NAME => 'testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:21,873 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 3960aa24086f70e10a20912542151ecc, NAME => 'testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:21,873 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1467c8a0b279ac201d66904269e50919, NAME => 'testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:21,889 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:21,890 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 90008c5ea3c222e0e54e8e39c9dfff9e, disabling compactions & flushes 2023-02-18 15:01:21,890 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:21,890 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:21,890 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. after waiting 0 ms 2023-02-18 15:01:21,890 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:21,890 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:21,890 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 90008c5ea3c222e0e54e8e39c9dfff9e: 2023-02-18 15:01:21,891 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 0dbc5c172d5fc74b7d700b64c781ca9a, NAME => 'testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:21,895 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:21,895 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7d9068d9e68549479feb6db13892c0a3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:21,895 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:21,895 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing b98a94ebff502da1d4174cd4ce4e5ccf, disabling compactions & flushes 2023-02-18 15:01:21,895 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:21,895 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:21,895 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. after waiting 0 ms 2023-02-18 15:01:21,895 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:21,895 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:21,895 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for b98a94ebff502da1d4174cd4ce4e5ccf: 2023-02-18 15:01:21,896 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 4cae14511ed442b847449e9510f13ebe, NAME => 'testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:21,900 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:21,900 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9e50833b32c94c828aab5f95d687aac7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:21,900 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 46bcb3c2382a4aa9b9b526901a984a1b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:21,902 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:21,902 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e4871ad6f67b42d187776a5479e60a8d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:21,904 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 927c71016e7e4d1995d948256eda770d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:21,904 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 1467c8a0b279ac201d66904269e50919, disabling compactions & flushes 2023-02-18 15:01:21,904 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:21,904 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:21,905 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. after waiting 0 ms 2023-02-18 15:01:21,905 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:21,905 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:21,905 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 1467c8a0b279ac201d66904269e50919: 2023-02-18 15:01:21,905 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8fcc4282e79948cf91a9093ac5179df9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:21,907 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d2ca2b9b31116f5f35f780e617081622, disabling compactions & flushes 2023-02-18 15:01:21,907 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:21,907 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:21,907 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. after waiting 0 ms 2023-02-18 15:01:21,907 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:21,907 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:21,907 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d2ca2b9b31116f5f35f780e617081622: 2023-02-18 15:01:21,916 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:21,916 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing e2a34af80dd34758100e2f6655c2e29c, disabling compactions & flushes 2023-02-18 15:01:21,916 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 81818eecc94c4d94b718087a6f6422fe from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:21,916 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:21,917 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:21,917 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. after waiting 0 ms 2023-02-18 15:01:21,917 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:21,917 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:21,917 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for e2a34af80dd34758100e2f6655c2e29c: 2023-02-18 15:01:21,918 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7685397c39d84f57a674759717357b28 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:21,920 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing e25baff02b43f460f4b436f6ee0282a5, disabling compactions & flushes 2023-02-18 15:01:21,920 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:21,920 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:21,920 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. after waiting 0 ms 2023-02-18 15:01:21,920 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:21,920 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:21,921 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for e25baff02b43f460f4b436f6ee0282a5: 2023-02-18 15:01:22,304 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:22,304 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:22,304 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink deddce61f4f04df6aed8949676dd6e88 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:22,304 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8db24621e2a640b8816358a85dbd1c1d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:22,307 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:22,308 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5463d79ff188416dbe3b111c9285c611 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:22,308 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:22,308 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 43387f73e9d144f6997df2bea2c70827 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:22,310 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 336e02c09721474cb40a155b01feb0e6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:22,310 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 47bd075e9eb24472a0b1104c9251df4d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:22,315 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 3960aa24086f70e10a20912542151ecc, disabling compactions & flushes 2023-02-18 15:01:22,315 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 16abf18e0a044cffa58e3e50c8cf6a04 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:22,315 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:22,315 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1220b11e9a004090aa47e609f8d0e897 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 15:01:22,315 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 70b18795206458e1174fc2cdebb02463, disabling compactions & flushes 2023-02-18 15:01:22,315 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:22,316 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:22,316 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. after waiting 0 ms 2023-02-18 15:01:22,316 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:22,316 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. after waiting 0 ms 2023-02-18 15:01:22,316 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:22,316 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:22,316 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 70b18795206458e1174fc2cdebb02463: 2023-02-18 15:01:22,316 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:22,316 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:22,316 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 3960aa24086f70e10a20912542151ecc: 2023-02-18 15:01:22,318 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 0dbc5c172d5fc74b7d700b64c781ca9a, disabling compactions & flushes 2023-02-18 15:01:22,318 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:22,318 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:22,318 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. after waiting 0 ms 2023-02-18 15:01:22,318 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:22,318 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:22,318 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 0dbc5c172d5fc74b7d700b64c781ca9a: 2023-02-18 15:01:22,324 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 4cae14511ed442b847449e9510f13ebe, disabling compactions & flushes 2023-02-18 15:01:22,324 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:22,324 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:22,324 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. after waiting 0 ms 2023-02-18 15:01:22,324 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:22,324 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:22,324 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 4cae14511ed442b847449e9510f13ebe: 2023-02-18 15:01:22,324 INFO [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676732477948 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:22,325 DEBUG [Listener at localhost/46609] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:22,325 DEBUG [Listener at localhost/46609] util.CommonFSUtils(682): File system contents for path hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363 2023-02-18 15:01:22,326 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-data/ 2023-02-18 15:01:22,326 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |----default/ 2023-02-18 15:01:22,327 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-18 15:01:22,327 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |----------0dbc5c172d5fc74b7d700b64c781ca9a/ 2023-02-18 15:01:22,328 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:22,328 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:22,329 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=0dbc5c172d5fc74b7d700b64c781ca9a-43387f73e9d144f6997df2bea2c70827 2023-02-18 15:01:22,329 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:22,330 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=0dbc5c172d5fc74b7d700b64c781ca9a-1220b11e9a004090aa47e609f8d0e897 2023-02-18 15:01:22,330 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |----------1467c8a0b279ac201d66904269e50919/ 2023-02-18 15:01:22,330 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:22,331 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:22,334 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=1467c8a0b279ac201d66904269e50919-7d9068d9e68549479feb6db13892c0a3 2023-02-18 15:01:22,334 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:22,340 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=1467c8a0b279ac201d66904269e50919-46bcb3c2382a4aa9b9b526901a984a1b 2023-02-18 15:01:22,340 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |----------3960aa24086f70e10a20912542151ecc/ 2023-02-18 15:01:22,341 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:22,341 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:22,342 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=3960aa24086f70e10a20912542151ecc-deddce61f4f04df6aed8949676dd6e88 2023-02-18 15:01:22,342 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:22,342 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=3960aa24086f70e10a20912542151ecc-336e02c09721474cb40a155b01feb0e6 2023-02-18 15:01:22,342 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |----------4cae14511ed442b847449e9510f13ebe/ 2023-02-18 15:01:22,343 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:22,343 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:22,343 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=4cae14511ed442b847449e9510f13ebe-5463d79ff188416dbe3b111c9285c611 2023-02-18 15:01:22,343 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:22,344 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=4cae14511ed442b847449e9510f13ebe-16abf18e0a044cffa58e3e50c8cf6a04 2023-02-18 15:01:22,344 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |----------70b18795206458e1174fc2cdebb02463/ 2023-02-18 15:01:22,344 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:22,344 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:22,345 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=70b18795206458e1174fc2cdebb02463-8db24621e2a640b8816358a85dbd1c1d 2023-02-18 15:01:22,345 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:22,346 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=70b18795206458e1174fc2cdebb02463-47bd075e9eb24472a0b1104c9251df4d 2023-02-18 15:01:22,346 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |----------90008c5ea3c222e0e54e8e39c9dfff9e/ 2023-02-18 15:01:22,346 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:22,346 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |----------b98a94ebff502da1d4174cd4ce4e5ccf/ 2023-02-18 15:01:22,347 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:22,347 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |----------d2ca2b9b31116f5f35f780e617081622/ 2023-02-18 15:01:22,347 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:22,347 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:22,348 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=d2ca2b9b31116f5f35f780e617081622-9e50833b32c94c828aab5f95d687aac7 2023-02-18 15:01:22,348 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:22,348 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=d2ca2b9b31116f5f35f780e617081622-927c71016e7e4d1995d948256eda770d 2023-02-18 15:01:22,348 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |----------e25baff02b43f460f4b436f6ee0282a5/ 2023-02-18 15:01:22,349 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:22,349 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:22,349 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=e25baff02b43f460f4b436f6ee0282a5-81818eecc94c4d94b718087a6f6422fe 2023-02-18 15:01:22,349 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:22,350 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=e25baff02b43f460f4b436f6ee0282a5-7685397c39d84f57a674759717357b28 2023-02-18 15:01:22,350 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |----------e2a34af80dd34758100e2f6655c2e29c/ 2023-02-18 15:01:22,350 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:22,351 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:22,351 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=e2a34af80dd34758100e2f6655c2e29c-e4871ad6f67b42d187776a5479e60a8d 2023-02-18 15:01:22,351 DEBUG [Listener at localhost/46609] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:22,352 DEBUG [Listener at localhost/46609] util.CommonFSUtils(702): |----------------testWithMapReduce=e2a34af80dd34758100e2f6655c2e29c-8fcc4282e79948cf91a9093ac5179df9 2023-02-18 15:01:22,352 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:22,353 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:22,353 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:22,354 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:23,313 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/hadoop-4964018960185350348.jar 2023-02-18 15:01:23,314 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:23,314 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:23,381 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/hadoop-5253483295997737989.jar 2023-02-18 15:01:23,382 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:23,382 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:23,382 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:23,383 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:23,383 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:23,384 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:23,384 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-18 15:01:23,384 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-18 15:01:23,385 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-18 15:01:23,385 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-18 15:01:23,385 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-18 15:01:23,386 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-18 15:01:23,386 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-18 15:01:23,387 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-18 15:01:23,387 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-18 15:01:23,387 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-18 15:01:23,388 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:23,388 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 15:01:23,389 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 15:01:23,389 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 15:01:23,390 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 15:01:23,459 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/hadoop-5951298623867783881.jar 2023-02-18 15:01:23,460 DEBUG [Listener at localhost/46609] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 15:01:23,466 WARN [Listener at localhost/46609] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-18 15:01:23,473 WARN [Listener at localhost/46609] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-18 15:01:23,480 INFO [Listener at localhost/46609] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 15:01:23,614 WARN [Listener at localhost/46609] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/mapreduce.cluster.local.dir/1676732483566/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-18 15:01:23,614 WARN [Listener at localhost/46609] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/mapreduce.cluster.local.dir/1676732483566/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-18 15:01:23,658 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:23,659 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:23,660 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:23,662 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:23,663 DEBUG [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e/f1 2023-02-18 15:01:23,664 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90008c5ea3c222e0e54e8e39c9dfff9e columnFamilyName f1 2023-02-18 15:01:23,664 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] regionserver.HStore(310): Store=90008c5ea3c222e0e54e8e39c9dfff9e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,665 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 90008c5ea3c222e0e54e8e39c9dfff9e 2023-02-18 15:01:23,668 DEBUG [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/90008c5ea3c222e0e54e8e39c9dfff9e/f2 2023-02-18 15:01:23,668 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90008c5ea3c222e0e54e8e39c9dfff9e columnFamilyName f2 2023-02-18 15:01:23,669 INFO [StoreOpener-90008c5ea3c222e0e54e8e39c9dfff9e-1] regionserver.HStore(310): Store=90008c5ea3c222e0e54e8e39c9dfff9e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,669 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:23,669 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 90008c5ea3c222e0e54e8e39c9dfff9e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64145895, jitterRate=-0.044151678681373596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:23,669 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 90008c5ea3c222e0e54e8e39c9dfff9e: 2023-02-18 15:01:23,687 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 90008c5ea3c222e0e54e8e39c9dfff9e, disabling compactions & flushes 2023-02-18 15:01:23,687 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:23,687 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:23,687 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. after waiting 0 ms 2023-02-18 15:01:23,687 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:23,688 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732476541.90008c5ea3c222e0e54e8e39c9dfff9e. 2023-02-18 15:01:23,688 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 90008c5ea3c222e0e54e8e39c9dfff9e: 2023-02-18 15:01:23,690 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:23,691 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:23,692 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:23,694 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:23,695 DEBUG [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f1 2023-02-18 15:01:23,695 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0dbc5c172d5fc74b7d700b64c781ca9a columnFamilyName f1 2023-02-18 15:01:23,700 DEBUG [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f1/testWithMapReduce=0dbc5c172d5fc74b7d700b64c781ca9a-43387f73e9d144f6997df2bea2c70827 2023-02-18 15:01:23,701 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] regionserver.HStore(310): Store=0dbc5c172d5fc74b7d700b64c781ca9a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,701 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0dbc5c172d5fc74b7d700b64c781ca9a 2023-02-18 15:01:23,702 DEBUG [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f2 2023-02-18 15:01:23,702 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0dbc5c172d5fc74b7d700b64c781ca9a columnFamilyName f2 2023-02-18 15:01:23,707 DEBUG [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/0dbc5c172d5fc74b7d700b64c781ca9a/f2/testWithMapReduce=0dbc5c172d5fc74b7d700b64c781ca9a-1220b11e9a004090aa47e609f8d0e897 2023-02-18 15:01:23,707 INFO [StoreOpener-0dbc5c172d5fc74b7d700b64c781ca9a-1] regionserver.HStore(310): Store=0dbc5c172d5fc74b7d700b64c781ca9a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:23,707 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0dbc5c172d5fc74b7d700b64c781ca9a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65721510, jitterRate=-0.02067318558692932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:23,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0dbc5c172d5fc74b7d700b64c781ca9a: 2023-02-18 15:01:23,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0dbc5c172d5fc74b7d700b64c781ca9a, disabling compactions & flushes 2023-02-18 15:01:23,744 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:23,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:23,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. after waiting 0 ms 2023-02-18 15:01:23,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:23,749 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676732476541.0dbc5c172d5fc74b7d700b64c781ca9a. 2023-02-18 15:01:23,749 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0dbc5c172d5fc74b7d700b64c781ca9a: 2023-02-18 15:01:23,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:23,753 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:23,754 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:23,760 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:23,762 DEBUG [StoreOpener-3960aa24086f70e10a20912542151ecc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f1 2023-02-18 15:01:23,762 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3960aa24086f70e10a20912542151ecc columnFamilyName f1 2023-02-18 15:01:23,767 DEBUG [StoreOpener-3960aa24086f70e10a20912542151ecc-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f1/testWithMapReduce=3960aa24086f70e10a20912542151ecc-deddce61f4f04df6aed8949676dd6e88 2023-02-18 15:01:23,767 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] regionserver.HStore(310): Store=3960aa24086f70e10a20912542151ecc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,767 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3960aa24086f70e10a20912542151ecc 2023-02-18 15:01:23,768 DEBUG [StoreOpener-3960aa24086f70e10a20912542151ecc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f2 2023-02-18 15:01:23,769 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3960aa24086f70e10a20912542151ecc columnFamilyName f2 2023-02-18 15:01:23,773 DEBUG [StoreOpener-3960aa24086f70e10a20912542151ecc-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/3960aa24086f70e10a20912542151ecc/f2/testWithMapReduce=3960aa24086f70e10a20912542151ecc-336e02c09721474cb40a155b01feb0e6 2023-02-18 15:01:23,773 INFO [StoreOpener-3960aa24086f70e10a20912542151ecc-1] regionserver.HStore(310): Store=3960aa24086f70e10a20912542151ecc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:23,773 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3960aa24086f70e10a20912542151ecc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63397186, jitterRate=-0.05530831217765808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:23,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3960aa24086f70e10a20912542151ecc: 2023-02-18 15:01:23,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3960aa24086f70e10a20912542151ecc, disabling compactions & flushes 2023-02-18 15:01:23,816 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:23,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:23,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. after waiting 0 ms 2023-02-18 15:01:23,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:23,817 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676732476541.3960aa24086f70e10a20912542151ecc. 2023-02-18 15:01:23,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3960aa24086f70e10a20912542151ecc: 2023-02-18 15:01:23,821 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:23,821 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:23,826 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:23,829 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:23,830 DEBUG [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf/f1 2023-02-18 15:01:23,830 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b98a94ebff502da1d4174cd4ce4e5ccf columnFamilyName f1 2023-02-18 15:01:23,831 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] regionserver.HStore(310): Store=b98a94ebff502da1d4174cd4ce4e5ccf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,831 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b98a94ebff502da1d4174cd4ce4e5ccf 2023-02-18 15:01:23,833 DEBUG [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/b98a94ebff502da1d4174cd4ce4e5ccf/f2 2023-02-18 15:01:23,833 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b98a94ebff502da1d4174cd4ce4e5ccf columnFamilyName f2 2023-02-18 15:01:23,834 INFO [StoreOpener-b98a94ebff502da1d4174cd4ce4e5ccf-1] regionserver.HStore(310): Store=b98a94ebff502da1d4174cd4ce4e5ccf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,834 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:23,834 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b98a94ebff502da1d4174cd4ce4e5ccf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72085547, jitterRate=0.07415835559368134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:23,834 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b98a94ebff502da1d4174cd4ce4e5ccf: 2023-02-18 15:01:23,852 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b98a94ebff502da1d4174cd4ce4e5ccf, disabling compactions & flushes 2023-02-18 15:01:23,853 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:23,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:23,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. after waiting 0 ms 2023-02-18 15:01:23,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:23,853 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676732476541.b98a94ebff502da1d4174cd4ce4e5ccf. 2023-02-18 15:01:23,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b98a94ebff502da1d4174cd4ce4e5ccf: 2023-02-18 15:01:23,856 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:23,856 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:23,858 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:23,859 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:23,860 DEBUG [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f1 2023-02-18 15:01:23,860 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4cae14511ed442b847449e9510f13ebe columnFamilyName f1 2023-02-18 15:01:23,868 DEBUG [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f1/testWithMapReduce=4cae14511ed442b847449e9510f13ebe-5463d79ff188416dbe3b111c9285c611 2023-02-18 15:01:23,868 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] regionserver.HStore(310): Store=4cae14511ed442b847449e9510f13ebe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,868 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4cae14511ed442b847449e9510f13ebe 2023-02-18 15:01:23,869 DEBUG [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f2 2023-02-18 15:01:23,869 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4cae14511ed442b847449e9510f13ebe columnFamilyName f2 2023-02-18 15:01:23,874 DEBUG [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/4cae14511ed442b847449e9510f13ebe/f2/testWithMapReduce=4cae14511ed442b847449e9510f13ebe-16abf18e0a044cffa58e3e50c8cf6a04 2023-02-18 15:01:23,874 INFO [StoreOpener-4cae14511ed442b847449e9510f13ebe-1] regionserver.HStore(310): Store=4cae14511ed442b847449e9510f13ebe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,874 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:23,874 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4cae14511ed442b847449e9510f13ebe; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74969831, jitterRate=0.11713753640651703}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:23,874 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4cae14511ed442b847449e9510f13ebe: 2023-02-18 15:01:23,905 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4cae14511ed442b847449e9510f13ebe, disabling compactions & flushes 2023-02-18 15:01:23,905 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:23,905 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:23,905 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. after waiting 0 ms 2023-02-18 15:01:23,905 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:23,906 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676732476541.4cae14511ed442b847449e9510f13ebe. 2023-02-18 15:01:23,906 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4cae14511ed442b847449e9510f13ebe: 2023-02-18 15:01:23,910 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:23,910 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:23,913 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:23,915 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:23,916 DEBUG [StoreOpener-70b18795206458e1174fc2cdebb02463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f1 2023-02-18 15:01:23,916 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70b18795206458e1174fc2cdebb02463 columnFamilyName f1 2023-02-18 15:01:23,921 DEBUG [StoreOpener-70b18795206458e1174fc2cdebb02463-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f1/testWithMapReduce=70b18795206458e1174fc2cdebb02463-8db24621e2a640b8816358a85dbd1c1d 2023-02-18 15:01:23,921 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] regionserver.HStore(310): Store=70b18795206458e1174fc2cdebb02463/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,922 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 70b18795206458e1174fc2cdebb02463 2023-02-18 15:01:23,922 DEBUG [StoreOpener-70b18795206458e1174fc2cdebb02463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f2 2023-02-18 15:01:23,923 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70b18795206458e1174fc2cdebb02463 columnFamilyName f2 2023-02-18 15:01:23,927 DEBUG [StoreOpener-70b18795206458e1174fc2cdebb02463-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/70b18795206458e1174fc2cdebb02463/f2/testWithMapReduce=70b18795206458e1174fc2cdebb02463-47bd075e9eb24472a0b1104c9251df4d 2023-02-18 15:01:23,927 INFO [StoreOpener-70b18795206458e1174fc2cdebb02463-1] regionserver.HStore(310): Store=70b18795206458e1174fc2cdebb02463/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,928 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:23,928 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 70b18795206458e1174fc2cdebb02463; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62605833, jitterRate=-0.067100390791893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:23,928 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 70b18795206458e1174fc2cdebb02463: 2023-02-18 15:01:23,963 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 70b18795206458e1174fc2cdebb02463, disabling compactions & flushes 2023-02-18 15:01:23,964 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:23,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:23,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. after waiting 0 ms 2023-02-18 15:01:23,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:23,967 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676732476541.70b18795206458e1174fc2cdebb02463. 2023-02-18 15:01:23,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 70b18795206458e1174fc2cdebb02463: 2023-02-18 15:01:23,970 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:23,970 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:23,972 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:23,974 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:23,975 DEBUG [StoreOpener-1467c8a0b279ac201d66904269e50919-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f1 2023-02-18 15:01:23,975 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1467c8a0b279ac201d66904269e50919 columnFamilyName f1 2023-02-18 15:01:23,982 DEBUG [StoreOpener-1467c8a0b279ac201d66904269e50919-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f1/testWithMapReduce=1467c8a0b279ac201d66904269e50919-7d9068d9e68549479feb6db13892c0a3 2023-02-18 15:01:23,982 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] regionserver.HStore(310): Store=1467c8a0b279ac201d66904269e50919/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,982 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1467c8a0b279ac201d66904269e50919 2023-02-18 15:01:23,983 DEBUG [StoreOpener-1467c8a0b279ac201d66904269e50919-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f2 2023-02-18 15:01:23,983 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1467c8a0b279ac201d66904269e50919 columnFamilyName f2 2023-02-18 15:01:23,988 DEBUG [StoreOpener-1467c8a0b279ac201d66904269e50919-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/1467c8a0b279ac201d66904269e50919/f2/testWithMapReduce=1467c8a0b279ac201d66904269e50919-46bcb3c2382a4aa9b9b526901a984a1b 2023-02-18 15:01:23,989 INFO [StoreOpener-1467c8a0b279ac201d66904269e50919-1] regionserver.HStore(310): Store=1467c8a0b279ac201d66904269e50919/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:23,989 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:23,989 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1467c8a0b279ac201d66904269e50919; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59137199, jitterRate=-0.11878706514835358}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:23,989 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1467c8a0b279ac201d66904269e50919: 2023-02-18 15:01:24,042 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1467c8a0b279ac201d66904269e50919, disabling compactions & flushes 2023-02-18 15:01:24,042 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:24,042 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:24,042 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. after waiting 0 ms 2023-02-18 15:01:24,042 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:24,043 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676732476541.1467c8a0b279ac201d66904269e50919. 2023-02-18 15:01:24,043 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1467c8a0b279ac201d66904269e50919: 2023-02-18 15:01:24,046 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:24,046 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:24,047 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:24,049 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:24,050 DEBUG [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f1 2023-02-18 15:01:24,050 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2a34af80dd34758100e2f6655c2e29c columnFamilyName f1 2023-02-18 15:01:24,055 DEBUG [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f1/testWithMapReduce=e2a34af80dd34758100e2f6655c2e29c-e4871ad6f67b42d187776a5479e60a8d 2023-02-18 15:01:24,056 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] regionserver.HStore(310): Store=e2a34af80dd34758100e2f6655c2e29c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:24,056 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2a34af80dd34758100e2f6655c2e29c 2023-02-18 15:01:24,057 DEBUG [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f2 2023-02-18 15:01:24,057 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2a34af80dd34758100e2f6655c2e29c columnFamilyName f2 2023-02-18 15:01:24,061 DEBUG [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/e2a34af80dd34758100e2f6655c2e29c/f2/testWithMapReduce=e2a34af80dd34758100e2f6655c2e29c-8fcc4282e79948cf91a9093ac5179df9 2023-02-18 15:01:24,062 INFO [StoreOpener-e2a34af80dd34758100e2f6655c2e29c-1] regionserver.HStore(310): Store=e2a34af80dd34758100e2f6655c2e29c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:24,062 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:24,062 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e2a34af80dd34758100e2f6655c2e29c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71544689, jitterRate=0.06609894335269928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:24,062 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e2a34af80dd34758100e2f6655c2e29c: 2023-02-18 15:01:24,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e2a34af80dd34758100e2f6655c2e29c, disabling compactions & flushes 2023-02-18 15:01:24,090 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:24,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:24,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. after waiting 0 ms 2023-02-18 15:01:24,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:24,091 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676732476541.e2a34af80dd34758100e2f6655c2e29c. 2023-02-18 15:01:24,091 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e2a34af80dd34758100e2f6655c2e29c: 2023-02-18 15:01:24,095 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:24,095 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:24,096 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:24,097 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:24,098 DEBUG [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f1 2023-02-18 15:01:24,099 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2ca2b9b31116f5f35f780e617081622 columnFamilyName f1 2023-02-18 15:01:24,103 DEBUG [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f1/testWithMapReduce=d2ca2b9b31116f5f35f780e617081622-9e50833b32c94c828aab5f95d687aac7 2023-02-18 15:01:24,103 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] regionserver.HStore(310): Store=d2ca2b9b31116f5f35f780e617081622/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:24,103 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d2ca2b9b31116f5f35f780e617081622 2023-02-18 15:01:24,104 DEBUG [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f2 2023-02-18 15:01:24,104 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2ca2b9b31116f5f35f780e617081622 columnFamilyName f2 2023-02-18 15:01:24,108 DEBUG [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/d2ca2b9b31116f5f35f780e617081622/f2/testWithMapReduce=d2ca2b9b31116f5f35f780e617081622-927c71016e7e4d1995d948256eda770d 2023-02-18 15:01:24,108 INFO [StoreOpener-d2ca2b9b31116f5f35f780e617081622-1] regionserver.HStore(310): Store=d2ca2b9b31116f5f35f780e617081622/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:24,108 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:24,109 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d2ca2b9b31116f5f35f780e617081622; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69744168, jitterRate=0.039269089698791504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:24,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d2ca2b9b31116f5f35f780e617081622: 2023-02-18 15:01:24,137 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d2ca2b9b31116f5f35f780e617081622, disabling compactions & flushes 2023-02-18 15:01:24,138 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:24,138 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:24,138 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. after waiting 0 ms 2023-02-18 15:01:24,138 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:24,139 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676732476541.d2ca2b9b31116f5f35f780e617081622. 2023-02-18 15:01:24,139 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d2ca2b9b31116f5f35f780e617081622: 2023-02-18 15:01:24,141 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:24,141 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:24,142 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:24,145 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:24,146 DEBUG [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f1 2023-02-18 15:01:24,146 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e25baff02b43f460f4b436f6ee0282a5 columnFamilyName f1 2023-02-18 15:01:24,150 DEBUG [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f1/testWithMapReduce=e25baff02b43f460f4b436f6ee0282a5-81818eecc94c4d94b718087a6f6422fe 2023-02-18 15:01:24,150 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] regionserver.HStore(310): Store=e25baff02b43f460f4b436f6ee0282a5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:24,151 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e25baff02b43f460f4b436f6ee0282a5 2023-02-18 15:01:24,151 DEBUG [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f2 2023-02-18 15:01:24,152 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e25baff02b43f460f4b436f6ee0282a5 columnFamilyName f2 2023-02-18 15:01:24,157 DEBUG [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] regionserver.HStore(539): loaded hdfs://localhost:32933/user/jenkins/test-data/3021b191-c173-bac8-15bf-8a735e491363/testWithMapReduceAndOfflineHBaseMultiRegion/bfb97cc6-bb13-45da-83f1-13530682e363/data/default/testWithMapReduce/e25baff02b43f460f4b436f6ee0282a5/f2/testWithMapReduce=e25baff02b43f460f4b436f6ee0282a5-7685397c39d84f57a674759717357b28 2023-02-18 15:01:24,157 INFO [StoreOpener-e25baff02b43f460f4b436f6ee0282a5-1] regionserver.HStore(310): Store=e25baff02b43f460f4b436f6ee0282a5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:24,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:24,158 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e25baff02b43f460f4b436f6ee0282a5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67636980, jitterRate=0.007869541645050049}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:24,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e25baff02b43f460f4b436f6ee0282a5: 2023-02-18 15:01:24,187 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e25baff02b43f460f4b436f6ee0282a5, disabling compactions & flushes 2023-02-18 15:01:24,187 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:24,187 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:24,187 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. after waiting 0 ms 2023-02-18 15:01:24,187 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:24,188 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676732476541.e25baff02b43f460f4b436f6ee0282a5. 2023-02-18 15:01:24,188 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e25baff02b43f460f4b436f6ee0282a5: 2023-02-18 15:01:24,656 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 15:01:24,656 WARN [Listener at localhost/46609] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:24,659 INFO [Listener at localhost/46609] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:24,762 WARN [BP-761282874-172.31.14.131-1676732474450 heartbeating to localhost/127.0.0.1:32933] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:24,762 WARN [BP-761282874-172.31.14.131-1676732474450 heartbeating to localhost/127.0.0.1:32933] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-761282874-172.31.14.131-1676732474450 (Datanode Uuid fd1d6afb-cc55-4361-8d74-cf9f15e275eb) service to localhost/127.0.0.1:32933 2023-02-18 15:01:24,763 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/cluster_d0177970-bd8a-78ef-df77-67fe80ff0e0d/dfs/data/data3/current/BP-761282874-172.31.14.131-1676732474450] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:24,763 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/cluster_d0177970-bd8a-78ef-df77-67fe80ff0e0d/dfs/data/data4/current/BP-761282874-172.31.14.131-1676732474450] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:24,764 WARN [Listener at localhost/46609] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:24,767 INFO [Listener at localhost/46609] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:24,871 WARN [BP-761282874-172.31.14.131-1676732474450 heartbeating to localhost/127.0.0.1:32933] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:24,871 WARN [BP-761282874-172.31.14.131-1676732474450 heartbeating to localhost/127.0.0.1:32933] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-761282874-172.31.14.131-1676732474450 (Datanode Uuid 3564bd55-c01e-466e-9eec-2dd18c8c9f58) service to localhost/127.0.0.1:32933 2023-02-18 15:01:24,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/cluster_d0177970-bd8a-78ef-df77-67fe80ff0e0d/dfs/data/data1/current/BP-761282874-172.31.14.131-1676732474450] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:24,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/cluster_d0177970-bd8a-78ef-df77-67fe80ff0e0d/dfs/data/data2/current/BP-761282874-172.31.14.131-1676732474450] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:24,897 INFO [Listener at localhost/46609] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:25,017 INFO [Listener at localhost/46609] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 15:01:25,066 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 15:01:25,081 INFO [Listener at localhost/46609] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=152 (was 100) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:32933 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,39403,1676732475097)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:32933 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:32933 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:32933 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:32933 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:32933 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/46609 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:32933 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=530 (was 543), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=325 (was 315) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=8846 (was 9477) 2023-02-18 15:01:25,092 INFO [Listener at localhost/46609] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=152, OpenFileDescriptor=530, MaxFileDescriptor=60000, SystemLoadAverage=325, ProcessCount=171, AvailableMemoryMB=8846 2023-02-18 15:01:25,102 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/hadoop.log.dir so I do NOT create it in target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5 2023-02-18 15:01:25,102 WARN [Listener at localhost/46609] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 15:01:25,102 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/hadoop.tmp.dir so I do NOT create it in target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5 2023-02-18 15:01:25,102 WARN [Listener at localhost/46609] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4151f7d6-ea49-1018-2c81-2f7153d0810f/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 15:01:25,102 DEBUG [Listener at localhost/46609] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5 2023-02-18 15:01:25,103 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 15:01:25,103 INFO [Listener at localhost/46609] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/cluster_daa51f8f-7086-7284-f194-d49e7db6f551, deleteOnExit=true 2023-02-18 15:01:25,103 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 15:01:25,103 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/test.cache.data in system properties and HBase conf 2023-02-18 15:01:25,103 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 15:01:25,103 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/hadoop.log.dir in system properties and HBase conf 2023-02-18 15:01:25,103 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 15:01:25,103 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 15:01:25,103 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 15:01:25,103 DEBUG [Listener at localhost/46609] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 15:01:25,104 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:25,104 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:25,104 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 15:01:25,104 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:25,104 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 15:01:25,104 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 15:01:25,104 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:25,104 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:25,104 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 15:01:25,105 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/nfs.dump.dir in system properties and HBase conf 2023-02-18 15:01:25,105 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/java.io.tmpdir in system properties and HBase conf 2023-02-18 15:01:25,105 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:25,105 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 15:01:25,105 INFO [Listener at localhost/46609] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 15:01:25,109 WARN [Listener at localhost/46609] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:25,109 WARN [Listener at localhost/46609] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:25,152 WARN [Listener at localhost/46609] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:25,155 INFO [Listener at localhost/46609] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:25,161 INFO [Listener at localhost/46609] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/java.io.tmpdir/Jetty_localhost_43275_hdfs____wekztn/webapp 2023-02-18 15:01:25,293 INFO [Listener at localhost/46609] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43275 2023-02-18 15:01:25,298 WARN [Listener at localhost/46609] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:25,298 WARN [Listener at localhost/46609] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:25,378 WARN [Listener at localhost/44581] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:25,405 WARN [Listener at localhost/44581] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:25,410 WARN [Listener at localhost/44581] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:25,412 INFO [Listener at localhost/44581] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:25,421 INFO [Listener at localhost/44581] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/java.io.tmpdir/Jetty_localhost_32955_datanode____.9v8bb3/webapp 2023-02-18 15:01:25,543 INFO [Listener at localhost/44581] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32955 2023-02-18 15:01:25,551 WARN [Listener at localhost/42373] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:25,565 WARN [Listener at localhost/42373] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:25,568 WARN [Listener at localhost/42373] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:25,569 INFO [Listener at localhost/42373] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:25,573 INFO [Listener at localhost/42373] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/java.io.tmpdir/Jetty_localhost_36561_datanode____9qo5hw/webapp 2023-02-18 15:01:25,656 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbf74f11dc9287060: Processing first storage report for DS-11ff31a2-bb0e-4d37-88aa-bf45ff1c8763 from datanode 1f699a51-f2a1-4f7f-b76f-9d07cfec7683 2023-02-18 15:01:25,656 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbf74f11dc9287060: from storage DS-11ff31a2-bb0e-4d37-88aa-bf45ff1c8763 node DatanodeRegistration(127.0.0.1:44873, datanodeUuid=1f699a51-f2a1-4f7f-b76f-9d07cfec7683, infoPort=45887, infoSecurePort=0, ipcPort=42373, storageInfo=lv=-57;cid=testClusterID;nsid=9342295;c=1676732485112), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:25,656 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbf74f11dc9287060: Processing first storage report for DS-3121f383-6453-4efd-a536-dc02e2d1f276 from datanode 1f699a51-f2a1-4f7f-b76f-9d07cfec7683 2023-02-18 15:01:25,656 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbf74f11dc9287060: from storage DS-3121f383-6453-4efd-a536-dc02e2d1f276 node DatanodeRegistration(127.0.0.1:44873, datanodeUuid=1f699a51-f2a1-4f7f-b76f-9d07cfec7683, infoPort=45887, infoSecurePort=0, ipcPort=42373, storageInfo=lv=-57;cid=testClusterID;nsid=9342295;c=1676732485112), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:25,685 INFO [Listener at localhost/42373] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36561 2023-02-18 15:01:25,694 WARN [Listener at localhost/40695] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:25,825 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd3d2f9b44f950db: Processing first storage report for DS-6e213cdd-777c-4265-8136-2b03c7755c7d from datanode e25e74f0-61ba-4b49-b673-7164afbdca8b 2023-02-18 15:01:25,826 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd3d2f9b44f950db: from storage DS-6e213cdd-777c-4265-8136-2b03c7755c7d node DatanodeRegistration(127.0.0.1:37047, datanodeUuid=e25e74f0-61ba-4b49-b673-7164afbdca8b, infoPort=45155, infoSecurePort=0, ipcPort=40695, storageInfo=lv=-57;cid=testClusterID;nsid=9342295;c=1676732485112), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 15:01:25,826 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd3d2f9b44f950db: Processing first storage report for DS-a4ee7662-d970-4d71-bbb5-d231f7010863 from datanode e25e74f0-61ba-4b49-b673-7164afbdca8b 2023-02-18 15:01:25,826 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd3d2f9b44f950db: from storage DS-a4ee7662-d970-4d71-bbb5-d231f7010863 node DatanodeRegistration(127.0.0.1:37047, datanodeUuid=e25e74f0-61ba-4b49-b673-7164afbdca8b, infoPort=45155, infoSecurePort=0, ipcPort=40695, storageInfo=lv=-57;cid=testClusterID;nsid=9342295;c=1676732485112), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:25,917 DEBUG [Listener at localhost/40695] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5 2023-02-18 15:01:25,919 INFO [Listener at localhost/40695] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/cluster_daa51f8f-7086-7284-f194-d49e7db6f551/zookeeper_0, clientPort=59056, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/cluster_daa51f8f-7086-7284-f194-d49e7db6f551/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/cluster_daa51f8f-7086-7284-f194-d49e7db6f551/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 15:01:25,920 INFO [Listener at localhost/40695] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59056 2023-02-18 15:01:25,920 INFO [Listener at localhost/40695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:25,921 INFO [Listener at localhost/40695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:25,933 INFO [Listener at localhost/40695] util.FSUtils(479): Created version file at hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea with version=8 2023-02-18 15:01:25,933 INFO [Listener at localhost/40695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:25,934 INFO [Listener at localhost/40695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:25,935 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44581/user/jenkins/test-data/e47f5360-155f-1c3e-c8a4-488f72553b34/hbase-staging 2023-02-18 15:01:25,937 INFO [Listener at localhost/40695] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:25,937 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:25,937 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:25,937 INFO [Listener at localhost/40695] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:25,937 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:25,937 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:25,937 INFO [Listener at localhost/40695] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:25,938 INFO [Listener at localhost/40695] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37753 2023-02-18 15:01:25,939 INFO [Listener at localhost/40695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:25,940 INFO [Listener at localhost/40695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:25,940 INFO [Listener at localhost/40695] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37753 connecting to ZooKeeper ensemble=127.0.0.1:59056 2023-02-18 15:01:25,948 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:377530x0, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:25,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37753-0x10067f33ae40000 connected 2023-02-18 15:01:25,966 DEBUG [Listener at localhost/40695] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:25,967 DEBUG [Listener at localhost/40695] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:25,968 DEBUG [Listener at localhost/40695] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:25,972 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37753 2023-02-18 15:01:25,972 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37753 2023-02-18 15:01:25,974 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37753 2023-02-18 15:01:25,980 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37753 2023-02-18 15:01:25,980 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37753 2023-02-18 15:01:25,980 INFO [Listener at localhost/40695] master.HMaster(444): hbase.rootdir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea, hbase.cluster.distributed=false 2023-02-18 15:01:25,999 INFO [Listener at localhost/40695] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:25,999 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:25,999 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:26,000 INFO [Listener at localhost/40695] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:26,000 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:26,000 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:26,000 INFO [Listener at localhost/40695] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:26,002 INFO [Listener at localhost/40695] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39429 2023-02-18 15:01:26,003 INFO [Listener at localhost/40695] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:26,008 DEBUG [Listener at localhost/40695] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:26,008 INFO [Listener at localhost/40695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:26,009 INFO [Listener at localhost/40695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:26,010 INFO [Listener at localhost/40695] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39429 connecting to ZooKeeper ensemble=127.0.0.1:59056 2023-02-18 15:01:26,014 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:394290x0, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:26,015 DEBUG [Listener at localhost/40695] zookeeper.ZKUtil(164): regionserver:394290x0, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:26,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39429-0x10067f33ae40001 connected 2023-02-18 15:01:26,016 DEBUG [Listener at localhost/40695] zookeeper.ZKUtil(164): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:26,017 DEBUG [Listener at localhost/40695] zookeeper.ZKUtil(164): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:26,019 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39429 2023-02-18 15:01:26,020 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39429 2023-02-18 15:01:26,020 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39429 2023-02-18 15:01:26,023 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39429 2023-02-18 15:01:26,024 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39429 2023-02-18 15:01:26,037 INFO [Listener at localhost/40695] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:26,037 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:26,037 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:26,037 INFO [Listener at localhost/40695] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:26,037 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:26,037 INFO [Listener at localhost/40695] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:26,038 INFO [Listener at localhost/40695] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:26,045 INFO [Listener at localhost/40695] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34771 2023-02-18 15:01:26,046 INFO [Listener at localhost/40695] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:26,047 DEBUG [Listener at localhost/40695] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:26,047 INFO [Listener at localhost/40695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:26,048 INFO [Listener at localhost/40695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:26,049 INFO [Listener at localhost/40695] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34771 connecting to ZooKeeper ensemble=127.0.0.1:59056 2023-02-18 15:01:26,061 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:347710x0, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:26,063 DEBUG [Listener at localhost/40695] zookeeper.ZKUtil(164): regionserver:347710x0, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:26,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34771-0x10067f33ae40002 connected 2023-02-18 15:01:26,064 DEBUG [Listener at localhost/40695] zookeeper.ZKUtil(164): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:26,065 DEBUG [Listener at localhost/40695] zookeeper.ZKUtil(164): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:26,065 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34771 2023-02-18 15:01:26,065 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34771 2023-02-18 15:01:26,066 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34771 2023-02-18 15:01:26,069 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34771 2023-02-18 15:01:26,069 DEBUG [Listener at localhost/40695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34771 2023-02-18 15:01:26,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37753,1676732485936 2023-02-18 15:01:26,076 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:26,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37753,1676732485936 2023-02-18 15:01:26,078 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:26,078 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:26,078 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:26,078 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:26,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:26,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37753,1676732485936 from backup master directory 2023-02-18 15:01:26,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:26,082 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37753,1676732485936 2023-02-18 15:01:26,082 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:26,082 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:26,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37753,1676732485936 2023-02-18 15:01:26,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/hbase.id with ID: ea250409-28f5-42d7-ba0f-af3abf0c3a27 2023-02-18 15:01:26,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:26,122 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:26,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x07332bd1 to 127.0.0.1:59056 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:26,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7da7a4eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:26,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:26,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 15:01:26,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:26,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/data/master/store-tmp 2023-02-18 15:01:26,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:26,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:26,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:26,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:26,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:26,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:26,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:26,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:26,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/WALs/jenkins-hbase4.apache.org,37753,1676732485936 2023-02-18 15:01:26,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37753%2C1676732485936, suffix=, logDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/WALs/jenkins-hbase4.apache.org,37753,1676732485936, archiveDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/oldWALs, maxLogs=10 2023-02-18 15:01:26,200 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37047,DS-6e213cdd-777c-4265-8136-2b03c7755c7d,DISK] 2023-02-18 15:01:26,201 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44873,DS-11ff31a2-bb0e-4d37-88aa-bf45ff1c8763,DISK] 2023-02-18 15:01:26,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/WALs/jenkins-hbase4.apache.org,37753,1676732485936/jenkins-hbase4.apache.org%2C37753%2C1676732485936.1676732486173 2023-02-18 15:01:26,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37047,DS-6e213cdd-777c-4265-8136-2b03c7755c7d,DISK], DatanodeInfoWithStorage[127.0.0.1:44873,DS-11ff31a2-bb0e-4d37-88aa-bf45ff1c8763,DISK]] 2023-02-18 15:01:26,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:26,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:26,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:26,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:26,207 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:26,209 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 15:01:26,209 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 15:01:26,210 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:26,210 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:26,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:26,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:26,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:26,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72443832, jitterRate=0.07949721813201904}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:26,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:26,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 15:01:26,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 15:01:26,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 15:01:26,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 15:01:26,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 15:01:26,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 15:01:26,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 15:01:26,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 15:01:26,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 15:01:26,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 15:01:26,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 15:01:26,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 15:01:26,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 15:01:26,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 15:01:26,239 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:26,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 15:01:26,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 15:01:26,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 15:01:26,242 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:26,242 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:26,242 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:26,242 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:26,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37753,1676732485936, sessionid=0x10067f33ae40000, setting cluster-up flag (Was=false) 2023-02-18 15:01:26,249 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:26,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 15:01:26,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37753,1676732485936 2023-02-18 15:01:26,258 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:26,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 15:01:26,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37753,1676732485936 2023-02-18 15:01:26,263 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.hbase-snapshot/.tmp 2023-02-18 15:01:26,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:26,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:26,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:26,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:26,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:26,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 15:01:26,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:26,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676732516267 2023-02-18 15:01:26,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 15:01:26,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 15:01:26,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 15:01:26,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 15:01:26,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 15:01:26,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 15:01:26,268 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:26,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,268 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 15:01:26,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 15:01:26,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 15:01:26,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 15:01:26,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 15:01:26,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 15:01:26,270 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:26,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732486269,5,FailOnTimeoutGroup] 2023-02-18 15:01:26,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732486272,5,FailOnTimeoutGroup] 2023-02-18 15:01:26,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 15:01:26,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,274 INFO [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(952): ClusterId : ea250409-28f5-42d7-ba0f-af3abf0c3a27 2023-02-18 15:01:26,274 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(952): ClusterId : ea250409-28f5-42d7-ba0f-af3abf0c3a27 2023-02-18 15:01:26,275 DEBUG [RS:1;jenkins-hbase4:34771] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:26,275 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:26,277 DEBUG [RS:1;jenkins-hbase4:34771] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:26,277 DEBUG [RS:1;jenkins-hbase4:34771] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:26,277 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:26,277 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:26,279 DEBUG [RS:1;jenkins-hbase4:34771] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:26,279 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:26,281 DEBUG [RS:0;jenkins-hbase4:39429] zookeeper.ReadOnlyZKClient(139): Connect 0x6a76658c to 127.0.0.1:59056 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:26,281 DEBUG [RS:1;jenkins-hbase4:34771] zookeeper.ReadOnlyZKClient(139): Connect 0x32cbc5cf to 127.0.0.1:59056 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:26,293 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:26,294 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:26,294 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea 2023-02-18 15:01:26,294 DEBUG [RS:0;jenkins-hbase4:39429] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b196b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:26,294 DEBUG [RS:1;jenkins-hbase4:34771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c0c3de6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:26,294 DEBUG [RS:0;jenkins-hbase4:39429] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@608e0efc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:26,294 DEBUG [RS:1;jenkins-hbase4:34771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3833aebf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:26,304 DEBUG [RS:1;jenkins-hbase4:34771] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34771 2023-02-18 15:01:26,304 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39429 2023-02-18 15:01:26,304 INFO [RS:1;jenkins-hbase4:34771] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:26,304 INFO [RS:1;jenkins-hbase4:34771] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:26,304 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:26,304 DEBUG [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:26,304 INFO [RS:0;jenkins-hbase4:39429] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:26,304 INFO [RS:0;jenkins-hbase4:39429] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:26,304 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:26,305 INFO [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37753,1676732485936 with isa=jenkins-hbase4.apache.org/172.31.14.131:34771, startcode=1676732486036 2023-02-18 15:01:26,305 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37753,1676732485936 with isa=jenkins-hbase4.apache.org/172.31.14.131:39429, startcode=1676732485998 2023-02-18 15:01:26,305 DEBUG [RS:1;jenkins-hbase4:34771] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:26,305 DEBUG [RS:0;jenkins-hbase4:39429] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:26,306 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:26,308 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59967, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:26,308 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50185, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:26,308 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/info 2023-02-18 15:01:26,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37753] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:26,309 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:26,309 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:26,310 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea 2023-02-18 15:01:26,310 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44581 2023-02-18 15:01:26,310 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:26,310 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:26,310 DEBUG [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea 2023-02-18 15:01:26,310 DEBUG [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44581 2023-02-18 15:01:26,310 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:26,310 DEBUG [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:26,311 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:26,311 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:26,312 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:26,312 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:26,312 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:26,315 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/table 2023-02-18 15:01:26,315 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:26,315 DEBUG [RS:0;jenkins-hbase4:39429] zookeeper.ZKUtil(162): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:26,315 WARN [RS:0;jenkins-hbase4:39429] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:26,315 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39429,1676732485998] 2023-02-18 15:01:26,315 INFO [RS:0;jenkins-hbase4:39429] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:26,315 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34771,1676732486036] 2023-02-18 15:01:26,316 DEBUG [RS:1;jenkins-hbase4:34771] zookeeper.ZKUtil(162): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:26,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:26,316 WARN [RS:1;jenkins-hbase4:34771] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:26,316 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/WALs/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:26,316 INFO [RS:1;jenkins-hbase4:34771] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:26,316 DEBUG [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/WALs/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:26,316 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740 2023-02-18 15:01:26,317 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740 2023-02-18 15:01:26,320 DEBUG [RS:0;jenkins-hbase4:39429] zookeeper.ZKUtil(162): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:26,320 DEBUG [RS:1;jenkins-hbase4:34771] zookeeper.ZKUtil(162): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:26,321 DEBUG [RS:0;jenkins-hbase4:39429] zookeeper.ZKUtil(162): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:26,321 DEBUG [RS:1;jenkins-hbase4:34771] zookeeper.ZKUtil(162): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:26,321 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:26,322 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:26,322 DEBUG [RS:1;jenkins-hbase4:34771] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:26,322 INFO [RS:0;jenkins-hbase4:39429] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:26,322 INFO [RS:1;jenkins-hbase4:34771] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:26,322 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:26,323 INFO [RS:0;jenkins-hbase4:39429] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:26,323 INFO [RS:0;jenkins-hbase4:39429] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:26,323 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,323 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:26,324 INFO [RS:1;jenkins-hbase4:34771] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:26,324 INFO [RS:1;jenkins-hbase4:34771] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:26,325 INFO [RS:1;jenkins-hbase4:34771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,325 INFO [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:26,325 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,325 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:26,326 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,326 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,326 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,326 INFO [RS:1;jenkins-hbase4:34771] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,326 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,326 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,326 DEBUG [RS:1;jenkins-hbase4:34771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,326 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:26,327 DEBUG [RS:1;jenkins-hbase4:34771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,327 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,327 DEBUG [RS:1;jenkins-hbase4:34771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,327 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67139727, jitterRate=4.598945379257202E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:26,327 DEBUG [RS:1;jenkins-hbase4:34771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,327 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:26,327 DEBUG [RS:1;jenkins-hbase4:34771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,327 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:26,327 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,327 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:26,327 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,327 DEBUG [RS:1;jenkins-hbase4:34771] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:26,327 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,327 DEBUG [RS:1;jenkins-hbase4:34771] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,327 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:26,327 DEBUG [RS:1;jenkins-hbase4:34771] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,327 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:26,327 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:26,327 DEBUG [RS:1;jenkins-hbase4:34771] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,328 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,328 DEBUG [RS:1;jenkins-hbase4:34771] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:26,328 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,328 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,330 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:26,330 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:26,331 INFO [RS:1;jenkins-hbase4:34771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,331 INFO [RS:1;jenkins-hbase4:34771] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,331 INFO [RS:1;jenkins-hbase4:34771] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,332 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:26,332 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 15:01:26,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 15:01:26,334 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 15:01:26,338 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 15:01:26,346 INFO [RS:0;jenkins-hbase4:39429] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:26,346 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39429,1676732485998-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,347 INFO [RS:1;jenkins-hbase4:34771] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:26,347 INFO [RS:1;jenkins-hbase4:34771] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34771,1676732486036-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,374 INFO [RS:1;jenkins-hbase4:34771] regionserver.Replication(203): jenkins-hbase4.apache.org,34771,1676732486036 started 2023-02-18 15:01:26,374 INFO [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34771,1676732486036, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34771, sessionid=0x10067f33ae40002 2023-02-18 15:01:26,374 DEBUG [RS:1;jenkins-hbase4:34771] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:26,374 DEBUG [RS:1;jenkins-hbase4:34771] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:26,374 DEBUG [RS:1;jenkins-hbase4:34771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34771,1676732486036' 2023-02-18 15:01:26,374 DEBUG [RS:1;jenkins-hbase4:34771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:26,374 DEBUG [RS:1;jenkins-hbase4:34771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:26,375 DEBUG [RS:1;jenkins-hbase4:34771] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:26,375 DEBUG [RS:1;jenkins-hbase4:34771] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:26,375 DEBUG [RS:1;jenkins-hbase4:34771] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:26,375 DEBUG [RS:1;jenkins-hbase4:34771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34771,1676732486036' 2023-02-18 15:01:26,375 DEBUG [RS:1;jenkins-hbase4:34771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:26,375 DEBUG [RS:1;jenkins-hbase4:34771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:26,376 DEBUG [RS:1;jenkins-hbase4:34771] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:26,376 INFO [RS:1;jenkins-hbase4:34771] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:26,376 INFO [RS:1;jenkins-hbase4:34771] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:26,376 INFO [RS:0;jenkins-hbase4:39429] regionserver.Replication(203): jenkins-hbase4.apache.org,39429,1676732485998 started 2023-02-18 15:01:26,376 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39429,1676732485998, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39429, sessionid=0x10067f33ae40001 2023-02-18 15:01:26,376 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:26,376 DEBUG [RS:0;jenkins-hbase4:39429] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:26,376 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39429,1676732485998' 2023-02-18 15:01:26,376 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:26,377 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:26,377 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:26,377 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:26,377 DEBUG [RS:0;jenkins-hbase4:39429] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:26,377 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39429,1676732485998' 2023-02-18 15:01:26,377 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:26,378 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:26,378 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:26,378 INFO [RS:0;jenkins-hbase4:39429] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:26,378 INFO [RS:0;jenkins-hbase4:39429] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:26,489 DEBUG [jenkins-hbase4:37753] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 15:01:26,489 DEBUG [jenkins-hbase4:37753] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:26,491 DEBUG [jenkins-hbase4:37753] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:26,491 DEBUG [jenkins-hbase4:37753] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:26,491 DEBUG [jenkins-hbase4:37753] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:26,492 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39429,1676732485998, state=OPENING 2023-02-18 15:01:26,494 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 15:01:26,496 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:26,496 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39429,1676732485998}] 2023-02-18 15:01:26,497 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:26,598 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 15:01:26,652 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:26,652 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:26,654 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45904, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:26,658 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 15:01:26,658 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:26,660 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39429%2C1676732485998.meta, suffix=.meta, logDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/WALs/jenkins-hbase4.apache.org,39429,1676732485998, archiveDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/oldWALs, maxLogs=32 2023-02-18 15:01:26,676 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37047,DS-6e213cdd-777c-4265-8136-2b03c7755c7d,DISK] 2023-02-18 15:01:26,676 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44873,DS-11ff31a2-bb0e-4d37-88aa-bf45ff1c8763,DISK] 2023-02-18 15:01:26,678 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/WALs/jenkins-hbase4.apache.org,39429,1676732485998/jenkins-hbase4.apache.org%2C39429%2C1676732485998.meta.1676732486660.meta 2023-02-18 15:01:26,678 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37047,DS-6e213cdd-777c-4265-8136-2b03c7755c7d,DISK], DatanodeInfoWithStorage[127.0.0.1:44873,DS-11ff31a2-bb0e-4d37-88aa-bf45ff1c8763,DISK]] 2023-02-18 15:01:26,678 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:26,678 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 15:01:26,678 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 15:01:26,679 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 15:01:26,679 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 15:01:26,679 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:26,679 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 15:01:26,679 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 15:01:26,681 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:26,682 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/info 2023-02-18 15:01:26,682 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/info 2023-02-18 15:01:26,682 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:26,683 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:26,683 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:26,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:26,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:26,684 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:26,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:26,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:26,685 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/table 2023-02-18 15:01:26,685 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/table 2023-02-18 15:01:26,685 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:26,686 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:26,687 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740 2023-02-18 15:01:26,687 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740 2023-02-18 15:01:26,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:26,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:26,691 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67888951, jitterRate=0.011624202132225037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:26,691 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:26,692 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676732486652 2023-02-18 15:01:26,695 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 15:01:26,696 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 15:01:26,696 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39429,1676732485998, state=OPEN 2023-02-18 15:01:26,697 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 15:01:26,697 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:26,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 15:01:26,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39429,1676732485998 in 201 msec 2023-02-18 15:01:26,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 15:01:26,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 367 msec 2023-02-18 15:01:26,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 437 msec 2023-02-18 15:01:26,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676732486702, completionTime=-1 2023-02-18 15:01:26,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 15:01:26,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 15:01:26,708 DEBUG [hconnection-0x6aa47f59-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:26,710 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45910, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:26,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 15:01:26,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676732546711 2023-02-18 15:01:26,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676732606711 2023-02-18 15:01:26,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 9 msec 2023-02-18 15:01:26,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37753,1676732485936-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37753,1676732485936-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37753,1676732485936-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37753, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:26,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 15:01:26,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:26,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 15:01:26,720 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 15:01:26,720 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:26,721 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:26,722 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c 2023-02-18 15:01:26,723 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c empty. 2023-02-18 15:01:26,723 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c 2023-02-18 15:01:26,723 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 15:01:26,734 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:26,735 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => fd0d31eff05f6b70ed97c543ddf2566c, NAME => 'hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp 2023-02-18 15:01:26,752 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:26,752 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing fd0d31eff05f6b70ed97c543ddf2566c, disabling compactions & flushes 2023-02-18 15:01:26,752 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:26,752 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:26,752 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. after waiting 0 ms 2023-02-18 15:01:26,752 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:26,752 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:26,752 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for fd0d31eff05f6b70ed97c543ddf2566c: 2023-02-18 15:01:26,755 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:26,756 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732486756"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732486756"}]},"ts":"1676732486756"} 2023-02-18 15:01:26,760 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 15:01:26,761 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:26,761 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732486761"}]},"ts":"1676732486761"} 2023-02-18 15:01:26,764 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 15:01:26,770 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:26,773 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:26,773 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:26,773 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:26,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fd0d31eff05f6b70ed97c543ddf2566c, ASSIGN}] 2023-02-18 15:01:26,776 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fd0d31eff05f6b70ed97c543ddf2566c, ASSIGN 2023-02-18 15:01:26,776 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fd0d31eff05f6b70ed97c543ddf2566c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34771,1676732486036; forceNewPlan=false, retain=false 2023-02-18 15:01:26,927 INFO [jenkins-hbase4:37753] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 15:01:26,928 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fd0d31eff05f6b70ed97c543ddf2566c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:26,928 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732486928"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732486928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732486928"}]},"ts":"1676732486928"} 2023-02-18 15:01:26,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fd0d31eff05f6b70ed97c543ddf2566c, server=jenkins-hbase4.apache.org,34771,1676732486036}] 2023-02-18 15:01:27,085 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:27,085 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:27,086 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49774, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:27,090 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:27,092 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34771%2C1676732486036, suffix=, logDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/WALs/jenkins-hbase4.apache.org,34771,1676732486036, archiveDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/oldWALs, maxLogs=32 2023-02-18 15:01:27,110 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44873,DS-11ff31a2-bb0e-4d37-88aa-bf45ff1c8763,DISK] 2023-02-18 15:01:27,110 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37047,DS-6e213cdd-777c-4265-8136-2b03c7755c7d,DISK] 2023-02-18 15:01:27,112 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/WALs/jenkins-hbase4.apache.org,34771,1676732486036/jenkins-hbase4.apache.org%2C34771%2C1676732486036.1676732487093 2023-02-18 15:01:27,112 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37047,DS-6e213cdd-777c-4265-8136-2b03c7755c7d,DISK], DatanodeInfoWithStorage[127.0.0.1:44873,DS-11ff31a2-bb0e-4d37-88aa-bf45ff1c8763,DISK]] 2023-02-18 15:01:27,112 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fd0d31eff05f6b70ed97c543ddf2566c, NAME => 'hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:27,112 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fd0d31eff05f6b70ed97c543ddf2566c 2023-02-18 15:01:27,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:27,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fd0d31eff05f6b70ed97c543ddf2566c 2023-02-18 15:01:27,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fd0d31eff05f6b70ed97c543ddf2566c 2023-02-18 15:01:27,114 INFO [StoreOpener-fd0d31eff05f6b70ed97c543ddf2566c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fd0d31eff05f6b70ed97c543ddf2566c 2023-02-18 15:01:27,115 DEBUG [StoreOpener-fd0d31eff05f6b70ed97c543ddf2566c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c/info 2023-02-18 15:01:27,115 DEBUG [StoreOpener-fd0d31eff05f6b70ed97c543ddf2566c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c/info 2023-02-18 15:01:27,116 INFO [StoreOpener-fd0d31eff05f6b70ed97c543ddf2566c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd0d31eff05f6b70ed97c543ddf2566c columnFamilyName info 2023-02-18 15:01:27,116 INFO [StoreOpener-fd0d31eff05f6b70ed97c543ddf2566c-1] regionserver.HStore(310): Store=fd0d31eff05f6b70ed97c543ddf2566c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:27,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c 2023-02-18 15:01:27,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c 2023-02-18 15:01:27,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fd0d31eff05f6b70ed97c543ddf2566c 2023-02-18 15:01:27,122 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:27,123 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fd0d31eff05f6b70ed97c543ddf2566c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60632809, jitterRate=-0.09650073945522308}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:27,123 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fd0d31eff05f6b70ed97c543ddf2566c: 2023-02-18 15:01:27,123 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c., pid=6, masterSystemTime=1676732487085 2023-02-18 15:01:27,127 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:27,127 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:27,128 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fd0d31eff05f6b70ed97c543ddf2566c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:27,128 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732487128"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732487128"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732487128"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732487128"}]},"ts":"1676732487128"} 2023-02-18 15:01:27,134 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 15:01:27,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fd0d31eff05f6b70ed97c543ddf2566c, server=jenkins-hbase4.apache.org,34771,1676732486036 in 201 msec 2023-02-18 15:01:27,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 15:01:27,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fd0d31eff05f6b70ed97c543ddf2566c, ASSIGN in 362 msec 2023-02-18 15:01:27,137 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:27,137 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732487137"}]},"ts":"1676732487137"} 2023-02-18 15:01:27,138 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 15:01:27,141 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:27,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 422 msec 2023-02-18 15:01:27,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 15:01:27,222 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:27,222 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:27,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:27,225 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49784, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:27,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 15:01:27,235 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:27,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-18 15:01:27,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 15:01:27,246 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:27,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-18 15:01:27,252 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 15:01:27,256 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 15:01:27,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.174sec 2023-02-18 15:01:27,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 15:01:27,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 15:01:27,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 15:01:27,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37753,1676732485936-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 15:01:27,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37753,1676732485936-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 15:01:27,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 15:01:27,274 DEBUG [Listener at localhost/40695] zookeeper.ReadOnlyZKClient(139): Connect 0x1f5a155f to 127.0.0.1:59056 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:27,279 DEBUG [Listener at localhost/40695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ad18135, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:27,280 DEBUG [hconnection-0x69debd5f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:27,282 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45916, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:27,284 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37753,1676732485936 2023-02-18 15:01:27,284 DEBUG [Listener at localhost/40695] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 15:01:27,286 DEBUG [Listener at localhost/40695] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 15:01:27,288 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 15:01:27,288 INFO [Listener at localhost/40695] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:27,289 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:27,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 15:01:27,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:54816 deadline: 1676732547289, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:27,289 INFO [Listener at localhost/40695] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-18 15:01:27,292 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:27,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:27,296 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:27,296 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-18 15:01:27,297 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:27,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:27,298 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:27,299 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb empty. 2023-02-18 15:01:27,299 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:27,299 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-18 15:01:27,320 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:27,322 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 16659817ea927c7ff42cc1a3b70859fb, NAME => 'testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp 2023-02-18 15:01:27,333 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:27,333 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 16659817ea927c7ff42cc1a3b70859fb, disabling compactions & flushes 2023-02-18 15:01:27,333 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:27,333 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:27,333 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. after waiting 0 ms 2023-02-18 15:01:27,333 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:27,333 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:27,333 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 16659817ea927c7ff42cc1a3b70859fb: 2023-02-18 15:01:27,336 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:27,337 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676732487337"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732487337"}]},"ts":"1676732487337"} 2023-02-18 15:01:27,340 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 15:01:27,344 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:27,344 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732487344"}]},"ts":"1676732487344"} 2023-02-18 15:01:27,346 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-18 15:01:27,351 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:27,352 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:27,352 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:27,352 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:27,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=16659817ea927c7ff42cc1a3b70859fb, ASSIGN}] 2023-02-18 15:01:27,354 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=16659817ea927c7ff42cc1a3b70859fb, ASSIGN 2023-02-18 15:01:27,355 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=16659817ea927c7ff42cc1a3b70859fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39429,1676732485998; forceNewPlan=false, retain=false 2023-02-18 15:01:27,380 INFO [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39429%2C1676732485998, suffix=, logDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/WALs/jenkins-hbase4.apache.org,39429,1676732485998, archiveDir=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/oldWALs, maxLogs=32 2023-02-18 15:01:27,395 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44873,DS-11ff31a2-bb0e-4d37-88aa-bf45ff1c8763,DISK] 2023-02-18 15:01:27,396 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37047,DS-6e213cdd-777c-4265-8136-2b03c7755c7d,DISK] 2023-02-18 15:01:27,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:27,399 INFO [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/WALs/jenkins-hbase4.apache.org,39429,1676732485998/jenkins-hbase4.apache.org%2C39429%2C1676732485998.1676732487381 2023-02-18 15:01:27,399 DEBUG [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44873,DS-11ff31a2-bb0e-4d37-88aa-bf45ff1c8763,DISK], DatanodeInfoWithStorage[127.0.0.1:37047,DS-6e213cdd-777c-4265-8136-2b03c7755c7d,DISK]] 2023-02-18 15:01:27,506 INFO [jenkins-hbase4:37753] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 15:01:27,507 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=16659817ea927c7ff42cc1a3b70859fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:27,507 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676732487507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732487507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732487507"}]},"ts":"1676732487507"} 2023-02-18 15:01:27,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 16659817ea927c7ff42cc1a3b70859fb, server=jenkins-hbase4.apache.org,39429,1676732485998}] 2023-02-18 15:01:27,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:27,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:27,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 16659817ea927c7ff42cc1a3b70859fb, NAME => 'testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:27,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:27,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:27,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:27,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:27,666 INFO [StoreOpener-16659817ea927c7ff42cc1a3b70859fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:27,668 DEBUG [StoreOpener-16659817ea927c7ff42cc1a3b70859fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1 2023-02-18 15:01:27,668 DEBUG [StoreOpener-16659817ea927c7ff42cc1a3b70859fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1 2023-02-18 15:01:27,668 INFO [StoreOpener-16659817ea927c7ff42cc1a3b70859fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 16659817ea927c7ff42cc1a3b70859fb columnFamilyName f1 2023-02-18 15:01:27,668 INFO [StoreOpener-16659817ea927c7ff42cc1a3b70859fb-1] regionserver.HStore(310): Store=16659817ea927c7ff42cc1a3b70859fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:27,668 INFO [StoreOpener-16659817ea927c7ff42cc1a3b70859fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:27,670 DEBUG [StoreOpener-16659817ea927c7ff42cc1a3b70859fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2 2023-02-18 15:01:27,670 DEBUG [StoreOpener-16659817ea927c7ff42cc1a3b70859fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2 2023-02-18 15:01:27,670 INFO [StoreOpener-16659817ea927c7ff42cc1a3b70859fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 16659817ea927c7ff42cc1a3b70859fb columnFamilyName f2 2023-02-18 15:01:27,670 INFO [StoreOpener-16659817ea927c7ff42cc1a3b70859fb-1] regionserver.HStore(310): Store=16659817ea927c7ff42cc1a3b70859fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:27,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:27,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:27,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:27,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:27,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:27,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 16659817ea927c7ff42cc1a3b70859fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60330854, jitterRate=-0.10100021958351135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:27,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 16659817ea927c7ff42cc1a3b70859fb: 2023-02-18 15:01:27,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb., pid=12, masterSystemTime=1676732487661 2023-02-18 15:01:27,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:27,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:27,678 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=16659817ea927c7ff42cc1a3b70859fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:27,678 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676732487678"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732487678"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732487678"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732487678"}]},"ts":"1676732487678"} 2023-02-18 15:01:27,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 15:01:27,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 16659817ea927c7ff42cc1a3b70859fb, server=jenkins-hbase4.apache.org,39429,1676732485998 in 171 msec 2023-02-18 15:01:27,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 15:01:27,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=16659817ea927c7ff42cc1a3b70859fb, ASSIGN in 330 msec 2023-02-18 15:01:27,684 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:27,684 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732487684"}]},"ts":"1676732487684"} 2023-02-18 15:01:27,685 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-18 15:01:27,687 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:27,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 395 msec 2023-02-18 15:01:27,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:27,902 INFO [Listener at localhost/40695] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-18 15:01:27,902 DEBUG [Listener at localhost/40695] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-18 15:01:27,902 INFO [Listener at localhost/40695] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:27,904 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-18 15:01:27,904 INFO [Listener at localhost/40695] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:27,904 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-18 15:01:27,904 INFO [Listener at localhost/40695] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 15:01:27,941 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39429] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:28,031 INFO [Listener at localhost/40695] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 15:01:28,031 INFO [Listener at localhost/40695] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 15:01:28,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-18 15:01:28,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676732488032 (current time:1676732488032). 2023-02-18 15:01:28,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 15:01:28,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] zookeeper.ReadOnlyZKClient(139): Connect 0x2c11f180 to 127.0.0.1:59056 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:28,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@566c8307, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:28,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:28,040 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45918, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:28,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c11f180 to 127.0.0.1:59056 2023-02-18 15:01:28,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:28,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 15:01:28,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-18 15:01:28,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-18 15:01:28,044 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-18 15:01:28,045 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676733088045 2023-02-18 15:01:28,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-18 15:01:28,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:28,046 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:28,046 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 15:01:28,047 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-18 15:01:28,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-18 15:01:28,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-18 15:01:28,048 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-18 15:01:28,049 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676733088049 2023-02-18 15:01:28,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-18 15:01:28,060 INFO [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-18 15:01:28,061 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:28,061 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-18 15:01:28,061 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-18 15:01:28,144 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,144 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-18 15:01:28,146 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:28,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-18 15:01:28,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:28,148 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 15:01:28,148 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:28,148 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,148 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:28,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:28,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:28,148 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,148 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 15:01:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 15:01:28,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-18 15:01:28,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 15:01:28,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-18 15:01:28,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 15:01:28,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-18 15:01:28,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-18 15:01:28,149 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 15:01:28,150 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 15:01:28,150 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 15:01:28,150 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:28,151 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 15:01:28,151 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:28,151 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 15:01:28,151 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 15:01:28,151 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39429,1676732485998' joining acquired barrier for procedure (foo) in zk 2023-02-18 15:01:28,151 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 15:01:28,151 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 15:01:28,151 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34771,1676732486036' joining acquired barrier for procedure (foo) in zk 2023-02-18 15:01:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,153 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:28,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:28,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:28,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:28,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:28,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:28,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:28,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39429,1676732485998' joining acquired barrier for procedure 'foo' on coordinator 2023-02-18 15:01:28,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67f8f5e2[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:28,155 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-18 15:01:28,155 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,156 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,156 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,156 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 15:01:28,156 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 15:01:28,156 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,157 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:28,157 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 15:01:28,157 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 15:01:28,157 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 15:01:28,157 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34771,1676732486036' in zk 2023-02-18 15:01:28,157 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:28,157 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. started... 2023-02-18 15:01:28,157 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 16659817ea927c7ff42cc1a3b70859fb 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 15:01:28,159 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 15:01:28,159 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:28,159 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 15:01:28,348 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:28,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-18 15:01:28,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:28,350 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-18 15:01:28,575 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/.tmp/f1/0270108550984ae29d128ceec44979fb 2023-02-18 15:01:28,593 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/.tmp/f2/4926156ed91c4d2f857c3615ae6df00c 2023-02-18 15:01:28,597 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/.tmp/f1/0270108550984ae29d128ceec44979fb as hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1/0270108550984ae29d128ceec44979fb 2023-02-18 15:01:28,603 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1/0270108550984ae29d128ceec44979fb, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 15:01:28,604 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/.tmp/f2/4926156ed91c4d2f857c3615ae6df00c as hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2/4926156ed91c4d2f857c3615ae6df00c 2023-02-18 15:01:28,608 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2/4926156ed91c4d2f857c3615ae6df00c, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 15:01:28,609 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 16659817ea927c7ff42cc1a3b70859fb in 452ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:28,609 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-18 15:01:28,609 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 16659817ea927c7ff42cc1a3b70859fb: 2023-02-18 15:01:28,609 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.' region-info for snapshot=foo 2023-02-18 15:01:28,609 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:28,609 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1/0270108550984ae29d128ceec44979fb] hfiles 2023-02-18 15:01:28,609 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1/0270108550984ae29d128ceec44979fb for snapshot=foo 2023-02-18 15:01:28,609 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2/4926156ed91c4d2f857c3615ae6df00c] hfiles 2023-02-18 15:01:28,610 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2/4926156ed91c4d2f857c3615ae6df00c for snapshot=foo 2023-02-18 15:01:28,617 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. completed. 2023-02-18 15:01:28,617 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:28,617 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 15:01:28,617 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 15:01:28,617 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,617 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 15:01:28,617 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,39429,1676732485998' in zk 2023-02-18 15:01:28,620 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 15:01:28,620 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,620 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:28,620 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 15:01:28,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:28,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:28,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:28,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:28,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:28,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:28,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:28,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,39429,1676732485998': 2023-02-18 15:01:28,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39429,1676732485998' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-18 15:01:28,623 INFO [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-18 15:01:28,623 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:28,624 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:28,624 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-18 15:01:28,624 INFO [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 15:01:28,625 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,625 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:28,625 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,625 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,625 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:28,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:28,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:28,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:28,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:28,626 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:28,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:28,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,626 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:28,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:28,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:28,629 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:28,629 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:28,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:28,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,636 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:28,636 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 15:01:28,636 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:28,636 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:28,636 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:28,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:28,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-18 15:01:28,636 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 15:01:28,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-18 15:01:28,636 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:28,636 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:28,636 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:28,636 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:28,636 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,637 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:28,637 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 15:01:28,637 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 15:01:28,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:28,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:28,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:28,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.hbase-snapshot/.tmp/foo 2023-02-18 15:01:28,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:28,650 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:28,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-18 15:01:28,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:28,652 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-18 15:01:28,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.hbase-snapshot/.tmp/foo to hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.hbase-snapshot/foo 2023-02-18 15:01:28,675 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-18 15:01:28,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.hbase-snapshot/.tmp/foo 2023-02-18 15:01:28,675 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.hbase-snapshot/.tmp/foo 2023-02-18 15:01:28,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676732488045Consolidate snapshot: foo at 1676732488636 (+591 ms)Loading Region manifests for foo at 1676732488636Writing data manifest for foo at 1676732488640 (+4 ms)Verifying snapshot: foo at 1676732488652 (+12 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676732488675 (+23 ms) 2023-02-18 15:01:28,676 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-18 15:01:28,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 631 msec 2023-02-18 15:01:29,152 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:29,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-18 15:01:29,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 15:01:29,154 INFO [Listener at localhost/40695] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 15:01:29,158 INFO [Listener at localhost/40695] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 15:01:29,162 INFO [Listener at localhost/40695] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 15:01:29,197 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39429] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:29,292 INFO [Listener at localhost/40695] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 15:01:29,298 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 15:01:29,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,301 INFO [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-18 15:01:29,301 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:29,302 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-18 15:01:29,302 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-18 15:01:29,302 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,303 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,305 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:29,305 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:29,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:29,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:29,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:29,305 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:29,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:29,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,309 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:29,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,310 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,309 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,310 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:29,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,312 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-18 15:01:29,312 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:29,319 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,320 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-18 15:01:29,320 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-18 15:01:29,320 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34771,1676732486036' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-18 15:01:29,320 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-18 15:01:29,320 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:29,321 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-18 15:01:29,321 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 15:01:29,321 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 15:01:29,321 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:29,321 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. started... 2023-02-18 15:01:29,321 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 16659817ea927c7ff42cc1a3b70859fb 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 15:01:29,324 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,324 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,324 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:29,338 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/.tmp/f1/1a95764e582f41b4bdcf0de009ebbceb 2023-02-18 15:01:29,357 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/.tmp/f2/63c87ceba9404e319802831eace83a9c 2023-02-18 15:01:29,361 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/.tmp/f1/1a95764e582f41b4bdcf0de009ebbceb as hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1/1a95764e582f41b4bdcf0de009ebbceb 2023-02-18 15:01:29,365 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1/1a95764e582f41b4bdcf0de009ebbceb, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 15:01:29,366 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/.tmp/f2/63c87ceba9404e319802831eace83a9c as hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2/63c87ceba9404e319802831eace83a9c 2023-02-18 15:01:29,370 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2/63c87ceba9404e319802831eace83a9c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 15:01:29,371 INFO [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 16659817ea927c7ff42cc1a3b70859fb in 50ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:29,372 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 16659817ea927c7ff42cc1a3b70859fb: 2023-02-18 15:01:29,372 DEBUG [rs(jenkins-hbase4.apache.org,39429,1676732485998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:29,372 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 15:01:29,372 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 15:01:29,372 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,372 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-18 15:01:29,372 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39429,1676732485998' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-18 15:01:29,374 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,374 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:29,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:29,374 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,374 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:29,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:29,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:29,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:29,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:29,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39429,1676732485998' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-18 15:01:29,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63c76dc5[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:29,376 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-18 15:01:29,376 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,377 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,377 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,378 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-18 15:01:29,378 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-18 15:01:29,378 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,34771,1676732486036' in zk 2023-02-18 15:01:29,378 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-18 15:01:29,378 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-18 15:01:29,378 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,378 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:29,378 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,39429,1676732485998' in zk 2023-02-18 15:01:29,381 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-18 15:01:29,381 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:29,381 DEBUG [member: 'jenkins-hbase4.apache.org,34771,1676732486036' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-18 15:01:29,382 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-18 15:01:29,382 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,382 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:29,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:29,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:29,382 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1676732485998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-18 15:01:29,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:29,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:29,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:29,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:29,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:29,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,39429,1676732485998': 2023-02-18 15:01:29,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39429,1676732485998' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-18 15:01:29,386 INFO [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-18 15:01:29,386 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:29,386 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:29,386 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,386 INFO [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 15:01:29,387 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,387 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:29,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:29,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,387 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:29,387 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,388 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:29,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:29,388 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:29,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:29,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:29,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:29,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:29,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,388 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:29,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:29,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,390 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:29,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:29,390 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:29,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,392 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:29,392 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:29,392 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:29,393 DEBUG [(jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:29,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:29,393 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,393 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:29,394 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:29,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:29,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:29,393 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:29,393 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-18 15:01:29,394 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 15:01:29,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:29,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:29,394 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,394 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,394 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,394 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:29,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:29,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:29,394 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,394 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,394 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:29,394 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 15:01:29,494 DEBUG [Listener at localhost/40695] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 15:01:29,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 15:01:29,500 INFO [Listener at localhost/40695] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676732488032 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:29,501 DEBUG [Listener at localhost/40695] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44581/user/jenkins/test-data/e47f5360-155f-1c3e-c8a4-488f72553b34/foo/5a280ccf-b3c0-48ce-bbf5-4984904a8979/data/default/testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,501 INFO [Listener at localhost/40695] snapshot.RestoreSnapshotHelper(239): region to add: 16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:29,501 INFO [Listener at localhost/40695] snapshot.RestoreSnapshotHelper(585): clone region=16659817ea927c7ff42cc1a3b70859fb as 16659817ea927c7ff42cc1a3b70859fb in snapshot foo 2023-02-18 15:01:29,502 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 16659817ea927c7ff42cc1a3b70859fb, NAME => 'testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44581/user/jenkins/test-data/e47f5360-155f-1c3e-c8a4-488f72553b34/foo/5a280ccf-b3c0-48ce-bbf5-4984904a8979 2023-02-18 15:01:29,508 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:29,508 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0270108550984ae29d128ceec44979fb from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,510 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4926156ed91c4d2f857c3615ae6df00c from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,512 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 16659817ea927c7ff42cc1a3b70859fb, disabling compactions & flushes 2023-02-18 15:01:29,512 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:29,512 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:29,512 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. after waiting 0 ms 2023-02-18 15:01:29,512 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:29,512 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:29,512 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 16659817ea927c7ff42cc1a3b70859fb: 2023-02-18 15:01:29,513 INFO [Listener at localhost/40695] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676732488032 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:29,513 DEBUG [Listener at localhost/40695] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44581/user/jenkins/test-data/e47f5360-155f-1c3e-c8a4-488f72553b34/foo/5a280ccf-b3c0-48ce-bbf5-4984904a8979 2023-02-18 15:01:29,513 DEBUG [Listener at localhost/40695] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44581/user/jenkins/test-data/e47f5360-155f-1c3e-c8a4-488f72553b34/foo/5a280ccf-b3c0-48ce-bbf5-4984904a8979 2023-02-18 15:01:29,513 DEBUG [Listener at localhost/40695] util.CommonFSUtils(699): |-data/ 2023-02-18 15:01:29,514 DEBUG [Listener at localhost/40695] util.CommonFSUtils(699): |----default/ 2023-02-18 15:01:29,514 DEBUG [Listener at localhost/40695] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-18 15:01:29,515 DEBUG [Listener at localhost/40695] util.CommonFSUtils(699): |----------16659817ea927c7ff42cc1a3b70859fb/ 2023-02-18 15:01:29,515 DEBUG [Listener at localhost/40695] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:29,515 DEBUG [Listener at localhost/40695] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:29,515 DEBUG [Listener at localhost/40695] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=16659817ea927c7ff42cc1a3b70859fb-0270108550984ae29d128ceec44979fb 2023-02-18 15:01:29,515 DEBUG [Listener at localhost/40695] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:29,516 DEBUG [Listener at localhost/40695] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=16659817ea927c7ff42cc1a3b70859fb-4926156ed91c4d2f857c3615ae6df00c 2023-02-18 15:01:29,517 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-18 15:01:29,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-18 15:01:29,520 INFO [Listener at localhost/40695] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,520 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:29,523 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732489523"}]},"ts":"1676732489523"} 2023-02-18 15:01:29,525 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-18 15:01:29,527 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-18 15:01:29,527 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=16659817ea927c7ff42cc1a3b70859fb, UNASSIGN}] 2023-02-18 15:01:29,529 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=16659817ea927c7ff42cc1a3b70859fb, UNASSIGN 2023-02-18 15:01:29,529 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=16659817ea927c7ff42cc1a3b70859fb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,529 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676732489529"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732489529"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732489529"}]},"ts":"1676732489529"} 2023-02-18 15:01:29,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 16659817ea927c7ff42cc1a3b70859fb, server=jenkins-hbase4.apache.org,39429,1676732485998}] 2023-02-18 15:01:29,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:29,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:29,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 16659817ea927c7ff42cc1a3b70859fb, disabling compactions & flushes 2023-02-18 15:01:29,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:29,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:29,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. after waiting 0 ms 2023-02-18 15:01:29,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:29,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:29,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb. 2023-02-18 15:01:29,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 16659817ea927c7ff42cc1a3b70859fb: 2023-02-18 15:01:29,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:29,689 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=16659817ea927c7ff42cc1a3b70859fb, regionState=CLOSED 2023-02-18 15:01:29,689 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676732489689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732489689"}]},"ts":"1676732489689"} 2023-02-18 15:01:29,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 15:01:29,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 16659817ea927c7ff42cc1a3b70859fb, server=jenkins-hbase4.apache.org,39429,1676732485998 in 160 msec 2023-02-18 15:01:29,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 15:01:29,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=16659817ea927c7ff42cc1a3b70859fb, UNASSIGN in 165 msec 2023-02-18 15:01:29,694 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732489694"}]},"ts":"1676732489694"} 2023-02-18 15:01:29,695 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-18 15:01:29,697 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-18 15:01:29,698 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-18 15:01:29,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:29,828 INFO [Listener at localhost/40695] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-18 15:01:29,828 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,831 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,832 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 15:01:29,835 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:29,837 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1, FileablePath, hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2, FileablePath, hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/recovered.edits] 2023-02-18 15:01:29,840 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1/0270108550984ae29d128ceec44979fb to hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/archive/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1/0270108550984ae29d128ceec44979fb 2023-02-18 15:01:29,842 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1/1a95764e582f41b4bdcf0de009ebbceb to hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/archive/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f1/1a95764e582f41b4bdcf0de009ebbceb 2023-02-18 15:01:29,845 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2/4926156ed91c4d2f857c3615ae6df00c to hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/archive/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2/4926156ed91c4d2f857c3615ae6df00c 2023-02-18 15:01:29,846 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2/63c87ceba9404e319802831eace83a9c to hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/archive/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/f2/63c87ceba9404e319802831eace83a9c 2023-02-18 15:01:29,848 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/recovered.edits/12.seqid to hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/archive/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb/recovered.edits/12.seqid 2023-02-18 15:01:29,849 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/.tmp/data/default/testInitTableSnapshotMapperJobConfig/16659817ea927c7ff42cc1a3b70859fb 2023-02-18 15:01:29,849 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-18 15:01:29,851 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,853 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-18 15:01:29,855 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-18 15:01:29,855 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,855 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-18 15:01:29,856 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732489855"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:29,857 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 15:01:29,857 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 16659817ea927c7ff42cc1a3b70859fb, NAME => 'testInitTableSnapshotMapperJobConfig,,1676732487291.16659817ea927c7ff42cc1a3b70859fb.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 15:01:29,857 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-18 15:01:29,857 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676732489857"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:29,860 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-18 15:01:29,862 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 15:01:29,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 34 msec 2023-02-18 15:01:29,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37753] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 15:01:29,934 INFO [Listener at localhost/40695] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-18 15:01:29,934 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 15:01:29,934 INFO [Listener at localhost/40695] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 15:01:29,935 DEBUG [Listener at localhost/40695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f5a155f to 127.0.0.1:59056 2023-02-18 15:01:29,935 DEBUG [Listener at localhost/40695] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:29,935 DEBUG [Listener at localhost/40695] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 15:01:29,935 DEBUG [Listener at localhost/40695] util.JVMClusterUtil(257): Found active master hash=23043143, stopped=false 2023-02-18 15:01:29,935 INFO [Listener at localhost/40695] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37753,1676732485936 2023-02-18 15:01:29,943 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:29,943 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:29,943 INFO [Listener at localhost/40695] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 15:01:29,943 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:29,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:29,943 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:29,944 DEBUG [Listener at localhost/40695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07332bd1 to 127.0.0.1:59056 2023-02-18 15:01:29,944 DEBUG [Listener at localhost/40695] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:29,944 INFO [Listener at localhost/40695] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39429,1676732485998' ***** 2023-02-18 15:01:29,944 INFO [Listener at localhost/40695] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:29,944 INFO [Listener at localhost/40695] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34771,1676732486036' ***** 2023-02-18 15:01:29,944 INFO [Listener at localhost/40695] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:29,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:29,953 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:29,953 INFO [RS:0;jenkins-hbase4:39429] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:29,954 INFO [RS:1;jenkins-hbase4:34771] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:29,954 INFO [RS:1;jenkins-hbase4:34771] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:29,954 INFO [RS:1;jenkins-hbase4:34771] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:29,954 INFO [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(3304): Received CLOSE for fd0d31eff05f6b70ed97c543ddf2566c 2023-02-18 15:01:29,954 INFO [RS:0;jenkins-hbase4:39429] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:29,955 INFO [RS:0;jenkins-hbase4:39429] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:29,955 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:29,955 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:29,955 DEBUG [RS:0;jenkins-hbase4:39429] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a76658c to 127.0.0.1:59056 2023-02-18 15:01:29,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:29,956 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:29,956 DEBUG [RS:0;jenkins-hbase4:39429] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:29,956 INFO [RS:0;jenkins-hbase4:39429] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:29,956 INFO [RS:0;jenkins-hbase4:39429] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:29,956 INFO [RS:0;jenkins-hbase4:39429] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:29,956 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 15:01:29,956 INFO [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:29,956 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 15:01:29,957 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-18 15:01:29,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fd0d31eff05f6b70ed97c543ddf2566c, disabling compactions & flushes 2023-02-18 15:01:29,956 DEBUG [RS:1;jenkins-hbase4:34771] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32cbc5cf to 127.0.0.1:59056 2023-02-18 15:01:29,958 DEBUG [RS:1;jenkins-hbase4:34771] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:29,958 INFO [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 15:01:29,958 DEBUG [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1479): Online Regions={fd0d31eff05f6b70ed97c543ddf2566c=hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c.} 2023-02-18 15:01:29,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:29,958 DEBUG [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1505): Waiting on fd0d31eff05f6b70ed97c543ddf2566c 2023-02-18 15:01:29,958 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:29,957 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-18 15:01:29,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:29,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:29,959 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:29,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. after waiting 0 ms 2023-02-18 15:01:29,959 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:29,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:29,959 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:29,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing fd0d31eff05f6b70ed97c543ddf2566c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 15:01:29,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-18 15:01:30,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c/.tmp/info/6ce28d97a87c4efb959f0d39a0740fc1 2023-02-18 15:01:30,007 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/.tmp/info/003e2f9d38654eedad0ce341fe22bea7 2023-02-18 15:01:30,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c/.tmp/info/6ce28d97a87c4efb959f0d39a0740fc1 as hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c/info/6ce28d97a87c4efb959f0d39a0740fc1 2023-02-18 15:01:30,013 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 003e2f9d38654eedad0ce341fe22bea7 2023-02-18 15:01:30,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c/info/6ce28d97a87c4efb959f0d39a0740fc1, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 15:01:30,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fd0d31eff05f6b70ed97c543ddf2566c in 60ms, sequenceid=6, compaction requested=false 2023-02-18 15:01:30,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/namespace/fd0d31eff05f6b70ed97c543ddf2566c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 15:01:30,033 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:30,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:30,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fd0d31eff05f6b70ed97c543ddf2566c: 2023-02-18 15:01:30,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676732486719.fd0d31eff05f6b70ed97c543ddf2566c. 2023-02-18 15:01:30,043 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/.tmp/rep_barrier/388a6570580e463ab83c35ee4341778c 2023-02-18 15:01:30,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 388a6570580e463ab83c35ee4341778c 2023-02-18 15:01:30,054 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/.tmp/table/b1827e5065654a68a98f3974203e1eb9 2023-02-18 15:01:30,059 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1827e5065654a68a98f3974203e1eb9 2023-02-18 15:01:30,059 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/.tmp/info/003e2f9d38654eedad0ce341fe22bea7 as hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/info/003e2f9d38654eedad0ce341fe22bea7 2023-02-18 15:01:30,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 003e2f9d38654eedad0ce341fe22bea7 2023-02-18 15:01:30,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/info/003e2f9d38654eedad0ce341fe22bea7, entries=12, sequenceid=21, filesize=6.3 K 2023-02-18 15:01:30,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/.tmp/rep_barrier/388a6570580e463ab83c35ee4341778c as hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/rep_barrier/388a6570580e463ab83c35ee4341778c 2023-02-18 15:01:30,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 388a6570580e463ab83c35ee4341778c 2023-02-18 15:01:30,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/rep_barrier/388a6570580e463ab83c35ee4341778c, entries=1, sequenceid=21, filesize=5.0 K 2023-02-18 15:01:30,070 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/.tmp/table/b1827e5065654a68a98f3974203e1eb9 as hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/table/b1827e5065654a68a98f3974203e1eb9 2023-02-18 15:01:30,074 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1827e5065654a68a98f3974203e1eb9 2023-02-18 15:01:30,074 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/table/b1827e5065654a68a98f3974203e1eb9, entries=4, sequenceid=21, filesize=5.1 K 2023-02-18 15:01:30,075 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 116ms, sequenceid=21, compaction requested=false 2023-02-18 15:01:30,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 15:01:30,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 15:01:30,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:30,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:30,080 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:30,159 INFO [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34771,1676732486036; all regions closed. 2023-02-18 15:01:30,161 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39429,1676732485998; all regions closed. 2023-02-18 15:01:30,166 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/WALs/jenkins-hbase4.apache.org,34771,1676732486036/jenkins-hbase4.apache.org%2C34771%2C1676732486036.1676732487093 not finished, retry = 0 2023-02-18 15:01:30,166 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/WALs/jenkins-hbase4.apache.org,39429,1676732485998/jenkins-hbase4.apache.org%2C39429%2C1676732485998.meta.1676732486660.meta not finished, retry = 0 2023-02-18 15:01:30,268 DEBUG [RS:1;jenkins-hbase4:34771] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/oldWALs 2023-02-18 15:01:30,268 DEBUG [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/oldWALs 2023-02-18 15:01:30,268 INFO [RS:1;jenkins-hbase4:34771] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34771%2C1676732486036:(num 1676732487093) 2023-02-18 15:01:30,269 DEBUG [RS:1;jenkins-hbase4:34771] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:30,268 INFO [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39429%2C1676732485998.meta:.meta(num 1676732486660) 2023-02-18 15:01:30,269 INFO [RS:1;jenkins-hbase4:34771] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:30,269 INFO [RS:1;jenkins-hbase4:34771] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:30,269 INFO [RS:1;jenkins-hbase4:34771] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:30,269 INFO [RS:1;jenkins-hbase4:34771] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:30,269 INFO [RS:1;jenkins-hbase4:34771] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:30,269 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:30,270 INFO [RS:1;jenkins-hbase4:34771] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34771 2023-02-18 15:01:30,272 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:30,273 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:30,273 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34771,1676732486036 2023-02-18 15:01:30,273 ERROR [Listener at localhost/40695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1307087b rejected from java.util.concurrent.ThreadPoolExecutor@17389ec3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:30,273 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:30,273 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:30,273 ERROR [Listener at localhost/40695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@484d18d9 rejected from java.util.concurrent.ThreadPoolExecutor@17389ec3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:30,274 DEBUG [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/oldWALs 2023-02-18 15:01:30,274 INFO [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39429%2C1676732485998:(num 1676732487381) 2023-02-18 15:01:30,274 DEBUG [RS:0;jenkins-hbase4:39429] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:30,274 INFO [RS:0;jenkins-hbase4:39429] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:30,275 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:30,275 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:30,275 INFO [RS:0;jenkins-hbase4:39429] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39429 2023-02-18 15:01:30,276 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34771,1676732486036] 2023-02-18 15:01:30,276 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34771,1676732486036; numProcessing=1 2023-02-18 15:01:30,277 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39429,1676732485998 2023-02-18 15:01:30,277 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:30,277 ERROR [Listener at localhost/40695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@69495228 rejected from java.util.concurrent.ThreadPoolExecutor@6d76dbd9[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:30,278 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34771,1676732486036 already deleted, retry=false 2023-02-18 15:01:30,278 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34771,1676732486036 expired; onlineServers=1 2023-02-18 15:01:30,279 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39429,1676732485998] 2023-02-18 15:01:30,279 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39429,1676732485998; numProcessing=2 2023-02-18 15:01:30,281 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39429,1676732485998 already deleted, retry=false 2023-02-18 15:01:30,281 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39429,1676732485998 expired; onlineServers=0 2023-02-18 15:01:30,281 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37753,1676732485936' ***** 2023-02-18 15:01:30,281 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 15:01:30,282 DEBUG [M:0;jenkins-hbase4:37753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56008b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:30,282 INFO [M:0;jenkins-hbase4:37753] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37753,1676732485936 2023-02-18 15:01:30,282 INFO [M:0;jenkins-hbase4:37753] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37753,1676732485936; all regions closed. 2023-02-18 15:01:30,282 DEBUG [M:0;jenkins-hbase4:37753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:30,282 DEBUG [M:0;jenkins-hbase4:37753] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 15:01:30,282 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 15:01:30,282 DEBUG [M:0;jenkins-hbase4:37753] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 15:01:30,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732486272] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732486272,5,FailOnTimeoutGroup] 2023-02-18 15:01:30,283 INFO [M:0;jenkins-hbase4:37753] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 15:01:30,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732486269] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732486269,5,FailOnTimeoutGroup] 2023-02-18 15:01:30,283 INFO [M:0;jenkins-hbase4:37753] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 15:01:30,283 INFO [M:0;jenkins-hbase4:37753] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 15:01:30,284 DEBUG [M:0;jenkins-hbase4:37753] master.HMaster(1512): Stopping service threads 2023-02-18 15:01:30,284 INFO [M:0;jenkins-hbase4:37753] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 15:01:30,284 ERROR [M:0;jenkins-hbase4:37753] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 15:01:30,284 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:30,284 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:30,284 INFO [M:0;jenkins-hbase4:37753] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 15:01:30,284 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 15:01:30,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:30,285 DEBUG [M:0;jenkins-hbase4:37753] zookeeper.ZKUtil(398): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 15:01:30,285 WARN [M:0;jenkins-hbase4:37753] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 15:01:30,285 INFO [M:0;jenkins-hbase4:37753] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 15:01:30,285 INFO [M:0;jenkins-hbase4:37753] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 15:01:30,286 DEBUG [M:0;jenkins-hbase4:37753] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:30,286 INFO [M:0;jenkins-hbase4:37753] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:30,286 DEBUG [M:0;jenkins-hbase4:37753] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:30,286 DEBUG [M:0;jenkins-hbase4:37753] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:30,286 DEBUG [M:0;jenkins-hbase4:37753] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:30,286 INFO [M:0;jenkins-hbase4:37753] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.85 KB 2023-02-18 15:01:30,294 INFO [M:0;jenkins-hbase4:37753] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0f105f1a9475498d92c0a00025099b77 2023-02-18 15:01:30,299 DEBUG [M:0;jenkins-hbase4:37753] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0f105f1a9475498d92c0a00025099b77 as hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0f105f1a9475498d92c0a00025099b77 2023-02-18 15:01:30,302 INFO [M:0;jenkins-hbase4:37753] regionserver.HStore(1080): Added hdfs://localhost:44581/user/jenkins/test-data/f7ee8636-97a0-bf2d-4ec3-c9ea838347ea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0f105f1a9475498d92c0a00025099b77, entries=17, sequenceid=132, filesize=8.7 K 2023-02-18 15:01:30,303 INFO [M:0;jenkins-hbase4:37753] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-18 15:01:30,304 INFO [M:0;jenkins-hbase4:37753] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:30,304 DEBUG [M:0;jenkins-hbase4:37753] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:30,307 INFO [M:0;jenkins-hbase4:37753] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 15:01:30,307 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:30,307 INFO [M:0;jenkins-hbase4:37753] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37753 2023-02-18 15:01:30,309 DEBUG [M:0;jenkins-hbase4:37753] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37753,1676732485936 already deleted, retry=false 2023-02-18 15:01:30,375 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:30,375 INFO [RS:1;jenkins-hbase4:34771] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34771,1676732486036; zookeeper connection closed. 2023-02-18 15:01:30,375 ERROR [Listener at localhost/40695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@303fd14a rejected from java.util.concurrent.ThreadPoolExecutor@17389ec3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:30,377 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c70b0f5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c70b0f5 2023-02-18 15:01:30,377 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:34771-0x10067f33ae40002, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:30,377 ERROR [Listener at localhost/40695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@123ea044 rejected from java.util.concurrent.ThreadPoolExecutor@17389ec3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:30,475 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:30,475 INFO [M:0;jenkins-hbase4:37753] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37753,1676732485936; zookeeper connection closed. 2023-02-18 15:01:30,475 ERROR [Listener at localhost/40695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@363ed008 rejected from java.util.concurrent.ThreadPoolExecutor@32015217[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:30,476 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): master:37753-0x10067f33ae40000, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:30,476 ERROR [Listener at localhost/40695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@640e7b5 rejected from java.util.concurrent.ThreadPoolExecutor@32015217[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:30,575 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:30,575 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39429,1676732485998; zookeeper connection closed. 2023-02-18 15:01:30,575 ERROR [Listener at localhost/40695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3aedae4c rejected from java.util.concurrent.ThreadPoolExecutor@6d76dbd9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:30,576 DEBUG [Listener at localhost/40695-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x10067f33ae40001, quorum=127.0.0.1:59056, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:30,576 ERROR [Listener at localhost/40695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4265dbc3 rejected from java.util.concurrent.ThreadPoolExecutor@6d76dbd9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:30,576 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3f2300c1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3f2300c1 2023-02-18 15:01:30,576 INFO [Listener at localhost/40695] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 15:01:30,576 WARN [Listener at localhost/40695] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:30,581 INFO [Listener at localhost/40695] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:30,687 WARN [BP-1090219906-172.31.14.131-1676732485112 heartbeating to localhost/127.0.0.1:44581] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:30,687 WARN [BP-1090219906-172.31.14.131-1676732485112 heartbeating to localhost/127.0.0.1:44581] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1090219906-172.31.14.131-1676732485112 (Datanode Uuid e25e74f0-61ba-4b49-b673-7164afbdca8b) service to localhost/127.0.0.1:44581 2023-02-18 15:01:30,688 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/cluster_daa51f8f-7086-7284-f194-d49e7db6f551/dfs/data/data3/current/BP-1090219906-172.31.14.131-1676732485112] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:30,688 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/cluster_daa51f8f-7086-7284-f194-d49e7db6f551/dfs/data/data4/current/BP-1090219906-172.31.14.131-1676732485112] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:30,689 WARN [Listener at localhost/40695] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:30,692 INFO [Listener at localhost/40695] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:30,796 WARN [BP-1090219906-172.31.14.131-1676732485112 heartbeating to localhost/127.0.0.1:44581] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:30,796 WARN [BP-1090219906-172.31.14.131-1676732485112 heartbeating to localhost/127.0.0.1:44581] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1090219906-172.31.14.131-1676732485112 (Datanode Uuid 1f699a51-f2a1-4f7f-b76f-9d07cfec7683) service to localhost/127.0.0.1:44581 2023-02-18 15:01:30,797 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/cluster_daa51f8f-7086-7284-f194-d49e7db6f551/dfs/data/data1/current/BP-1090219906-172.31.14.131-1676732485112] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:30,797 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/cluster_daa51f8f-7086-7284-f194-d49e7db6f551/dfs/data/data2/current/BP-1090219906-172.31.14.131-1676732485112] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:30,816 INFO [Listener at localhost/40695] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:30,929 INFO [Listener at localhost/40695] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 15:01:30,950 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 15:01:30,966 INFO [Listener at localhost/40695] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=177 (was 152) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:44581 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:44581 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:44581 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:44581 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37753,1676732485936)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44581 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:44581 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:44581 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/40695 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=565 (was 530) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=331 (was 325) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=8710 (was 8846) 2023-02-18 15:01:30,981 INFO [Listener at localhost/40695] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=177, OpenFileDescriptor=565, MaxFileDescriptor=60000, SystemLoadAverage=331, ProcessCount=171, AvailableMemoryMB=8709 2023-02-18 15:01:30,994 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/hadoop.log.dir so I do NOT create it in target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d 2023-02-18 15:01:30,994 WARN [Listener at localhost/40695] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 15:01:30,994 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/hadoop.tmp.dir so I do NOT create it in target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d 2023-02-18 15:01:30,994 WARN [Listener at localhost/40695] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/88281fd0-7750-1a88-bf06-aac715a641b5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 15:01:30,994 DEBUG [Listener at localhost/40695] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d 2023-02-18 15:01:30,994 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 15:01:30,994 INFO [Listener at localhost/40695] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/cluster_d34029f8-3ba3-200d-fd0b-6049e7b2998e, deleteOnExit=true 2023-02-18 15:01:30,994 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 15:01:30,995 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/test.cache.data in system properties and HBase conf 2023-02-18 15:01:30,995 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 15:01:30,995 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/hadoop.log.dir in system properties and HBase conf 2023-02-18 15:01:30,995 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 15:01:30,995 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 15:01:30,995 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 15:01:30,995 DEBUG [Listener at localhost/40695] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 15:01:30,995 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:30,996 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:30,996 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 15:01:30,996 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:30,996 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 15:01:30,996 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 15:01:30,996 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:30,997 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:30,997 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 15:01:30,997 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/nfs.dump.dir in system properties and HBase conf 2023-02-18 15:01:30,997 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/java.io.tmpdir in system properties and HBase conf 2023-02-18 15:01:30,997 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:30,997 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 15:01:30,997 INFO [Listener at localhost/40695] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 15:01:31,002 WARN [Listener at localhost/40695] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:31,002 WARN [Listener at localhost/40695] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:31,051 WARN [Listener at localhost/40695] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:31,053 INFO [Listener at localhost/40695] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:31,059 INFO [Listener at localhost/40695] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/java.io.tmpdir/Jetty_localhost_43799_hdfs____.t5tdpa/webapp 2023-02-18 15:01:31,151 INFO [Listener at localhost/40695] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43799 2023-02-18 15:01:31,155 WARN [Listener at localhost/40695] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:31,155 WARN [Listener at localhost/40695] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:31,205 WARN [Listener at localhost/45869] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:31,217 WARN [Listener at localhost/45869] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:31,219 WARN [Listener at localhost/45869] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:31,221 INFO [Listener at localhost/45869] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:31,227 INFO [Listener at localhost/45869] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/java.io.tmpdir/Jetty_localhost_38181_datanode____igr7bg/webapp 2023-02-18 15:01:31,322 INFO [Listener at localhost/45869] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38181 2023-02-18 15:01:31,330 WARN [Listener at localhost/44973] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:31,346 WARN [Listener at localhost/44973] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:31,348 WARN [Listener at localhost/44973] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:31,349 INFO [Listener at localhost/44973] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:31,356 INFO [Listener at localhost/44973] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/java.io.tmpdir/Jetty_localhost_34065_datanode____omadw5/webapp 2023-02-18 15:01:31,442 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd918cbeef0e77e17: Processing first storage report for DS-bdee30af-1d20-4804-904a-c9f5327ad782 from datanode f6b41277-f197-44f8-980a-e0be79953ff7 2023-02-18 15:01:31,442 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd918cbeef0e77e17: from storage DS-bdee30af-1d20-4804-904a-c9f5327ad782 node DatanodeRegistration(127.0.0.1:42047, datanodeUuid=f6b41277-f197-44f8-980a-e0be79953ff7, infoPort=43415, infoSecurePort=0, ipcPort=44973, storageInfo=lv=-57;cid=testClusterID;nsid=1555047102;c=1676732491004), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:31,442 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd918cbeef0e77e17: Processing first storage report for DS-87b73524-2b60-4058-9f3c-93a08cd3a4b0 from datanode f6b41277-f197-44f8-980a-e0be79953ff7 2023-02-18 15:01:31,443 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd918cbeef0e77e17: from storage DS-87b73524-2b60-4058-9f3c-93a08cd3a4b0 node DatanodeRegistration(127.0.0.1:42047, datanodeUuid=f6b41277-f197-44f8-980a-e0be79953ff7, infoPort=43415, infoSecurePort=0, ipcPort=44973, storageInfo=lv=-57;cid=testClusterID;nsid=1555047102;c=1676732491004), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 15:01:31,462 INFO [Listener at localhost/44973] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34065 2023-02-18 15:01:31,470 WARN [Listener at localhost/41495] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:31,567 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1edfedef136d4434: Processing first storage report for DS-90974e16-b120-4554-900c-b38a30739e2a from datanode d0832c41-ad5e-41a6-acd8-e51100ab5834 2023-02-18 15:01:31,567 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1edfedef136d4434: from storage DS-90974e16-b120-4554-900c-b38a30739e2a node DatanodeRegistration(127.0.0.1:36725, datanodeUuid=d0832c41-ad5e-41a6-acd8-e51100ab5834, infoPort=46609, infoSecurePort=0, ipcPort=41495, storageInfo=lv=-57;cid=testClusterID;nsid=1555047102;c=1676732491004), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:31,567 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1edfedef136d4434: Processing first storage report for DS-3f72aff5-fdbf-4121-a173-2be89d7ec4e9 from datanode d0832c41-ad5e-41a6-acd8-e51100ab5834 2023-02-18 15:01:31,567 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1edfedef136d4434: from storage DS-3f72aff5-fdbf-4121-a173-2be89d7ec4e9 node DatanodeRegistration(127.0.0.1:36725, datanodeUuid=d0832c41-ad5e-41a6-acd8-e51100ab5834, infoPort=46609, infoSecurePort=0, ipcPort=41495, storageInfo=lv=-57;cid=testClusterID;nsid=1555047102;c=1676732491004), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:31,577 DEBUG [Listener at localhost/41495] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d 2023-02-18 15:01:31,581 INFO [Listener at localhost/41495] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/cluster_d34029f8-3ba3-200d-fd0b-6049e7b2998e/zookeeper_0, clientPort=61834, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/cluster_d34029f8-3ba3-200d-fd0b-6049e7b2998e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/cluster_d34029f8-3ba3-200d-fd0b-6049e7b2998e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 15:01:31,582 INFO [Listener at localhost/41495] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61834 2023-02-18 15:01:31,582 INFO [Listener at localhost/41495] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:31,583 INFO [Listener at localhost/41495] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:31,595 INFO [Listener at localhost/41495] util.FSUtils(479): Created version file at hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905 with version=8 2023-02-18 15:01:31,595 INFO [Listener at localhost/41495] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:31,596 INFO [Listener at localhost/41495] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:31,598 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/hbase-staging 2023-02-18 15:01:31,600 INFO [Listener at localhost/41495] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:31,600 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:31,600 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:31,600 INFO [Listener at localhost/41495] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:31,600 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:31,601 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:31,601 INFO [Listener at localhost/41495] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:31,601 INFO [Listener at localhost/41495] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40113 2023-02-18 15:01:31,602 INFO [Listener at localhost/41495] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:31,602 INFO [Listener at localhost/41495] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:31,603 INFO [Listener at localhost/41495] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40113 connecting to ZooKeeper ensemble=127.0.0.1:61834 2023-02-18 15:01:31,612 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:401130x0, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:31,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40113-0x10067f351010000 connected 2023-02-18 15:01:31,625 DEBUG [Listener at localhost/41495] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:31,626 DEBUG [Listener at localhost/41495] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:31,626 DEBUG [Listener at localhost/41495] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:31,626 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40113 2023-02-18 15:01:31,627 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40113 2023-02-18 15:01:31,627 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40113 2023-02-18 15:01:31,627 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40113 2023-02-18 15:01:31,627 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40113 2023-02-18 15:01:31,627 INFO [Listener at localhost/41495] master.HMaster(444): hbase.rootdir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905, hbase.cluster.distributed=false 2023-02-18 15:01:31,640 INFO [Listener at localhost/41495] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:31,640 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:31,640 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:31,640 INFO [Listener at localhost/41495] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:31,640 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:31,640 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:31,640 INFO [Listener at localhost/41495] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:31,641 INFO [Listener at localhost/41495] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38837 2023-02-18 15:01:31,641 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:31,642 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:31,642 INFO [Listener at localhost/41495] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:31,643 INFO [Listener at localhost/41495] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:31,644 INFO [Listener at localhost/41495] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38837 connecting to ZooKeeper ensemble=127.0.0.1:61834 2023-02-18 15:01:31,648 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:388370x0, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:31,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38837-0x10067f351010001 connected 2023-02-18 15:01:31,649 DEBUG [Listener at localhost/41495] zookeeper.ZKUtil(164): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:31,649 DEBUG [Listener at localhost/41495] zookeeper.ZKUtil(164): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:31,650 DEBUG [Listener at localhost/41495] zookeeper.ZKUtil(164): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:31,652 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38837 2023-02-18 15:01:31,652 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38837 2023-02-18 15:01:31,652 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38837 2023-02-18 15:01:31,653 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38837 2023-02-18 15:01:31,653 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38837 2023-02-18 15:01:31,663 INFO [Listener at localhost/41495] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:31,664 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:31,664 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:31,664 INFO [Listener at localhost/41495] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:31,664 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:31,664 INFO [Listener at localhost/41495] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:31,664 INFO [Listener at localhost/41495] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:31,665 INFO [Listener at localhost/41495] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36479 2023-02-18 15:01:31,666 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:31,667 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:31,667 INFO [Listener at localhost/41495] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:31,668 INFO [Listener at localhost/41495] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:31,669 INFO [Listener at localhost/41495] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36479 connecting to ZooKeeper ensemble=127.0.0.1:61834 2023-02-18 15:01:31,672 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:364790x0, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:31,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36479-0x10067f351010002 connected 2023-02-18 15:01:31,673 DEBUG [Listener at localhost/41495] zookeeper.ZKUtil(164): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:31,674 DEBUG [Listener at localhost/41495] zookeeper.ZKUtil(164): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:31,674 DEBUG [Listener at localhost/41495] zookeeper.ZKUtil(164): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:31,674 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36479 2023-02-18 15:01:31,675 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36479 2023-02-18 15:01:31,675 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36479 2023-02-18 15:01:31,675 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36479 2023-02-18 15:01:31,675 DEBUG [Listener at localhost/41495] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36479 2023-02-18 15:01:31,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40113,1676732491599 2023-02-18 15:01:31,677 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:31,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40113,1676732491599 2023-02-18 15:01:31,679 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:31,679 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:31,679 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:31,679 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:31,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:31,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:31,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40113,1676732491599 from backup master directory 2023-02-18 15:01:31,684 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40113,1676732491599 2023-02-18 15:01:31,684 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:31,684 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:31,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40113,1676732491599 2023-02-18 15:01:31,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/hbase.id with ID: 1e8bde8e-f375-4bfa-89ec-60e7ba8f9cef 2023-02-18 15:01:31,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:31,746 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:31,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4817a437 to 127.0.0.1:61834 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:31,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@343dafc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:31,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:31,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 15:01:31,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:31,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/data/master/store-tmp 2023-02-18 15:01:31,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:31,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:31,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:31,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:31,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:31,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:31,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:31,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:31,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/WALs/jenkins-hbase4.apache.org,40113,1676732491599 2023-02-18 15:01:31,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40113%2C1676732491599, suffix=, logDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/WALs/jenkins-hbase4.apache.org,40113,1676732491599, archiveDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/oldWALs, maxLogs=10 2023-02-18 15:01:31,795 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42047,DS-bdee30af-1d20-4804-904a-c9f5327ad782,DISK] 2023-02-18 15:01:31,796 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36725,DS-90974e16-b120-4554-900c-b38a30739e2a,DISK] 2023-02-18 15:01:31,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/WALs/jenkins-hbase4.apache.org,40113,1676732491599/jenkins-hbase4.apache.org%2C40113%2C1676732491599.1676732491778 2023-02-18 15:01:31,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42047,DS-bdee30af-1d20-4804-904a-c9f5327ad782,DISK], DatanodeInfoWithStorage[127.0.0.1:36725,DS-90974e16-b120-4554-900c-b38a30739e2a,DISK]] 2023-02-18 15:01:31,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:31,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:31,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:31,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:31,805 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:31,808 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 15:01:31,809 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 15:01:31,809 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:31,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:31,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:31,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:31,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:31,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62916094, jitterRate=-0.06247714161872864}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:31,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:31,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 15:01:31,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 15:01:31,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 15:01:31,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 15:01:31,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 15:01:31,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 15:01:31,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 15:01:31,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 15:01:31,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 15:01:31,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 15:01:31,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 15:01:31,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 15:01:31,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 15:01:31,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 15:01:31,846 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:31,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 15:01:31,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 15:01:31,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 15:01:31,850 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:31,850 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:31,850 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:31,850 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:31,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40113,1676732491599, sessionid=0x10067f351010000, setting cluster-up flag (Was=false) 2023-02-18 15:01:31,855 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:31,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 15:01:31,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40113,1676732491599 2023-02-18 15:01:31,863 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:31,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 15:01:31,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40113,1676732491599 2023-02-18 15:01:31,869 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.hbase-snapshot/.tmp 2023-02-18 15:01:31,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:31,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:31,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:31,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:31,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:31,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 15:01:31,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:31,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,877 INFO [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(952): ClusterId : 1e8bde8e-f375-4bfa-89ec-60e7ba8f9cef 2023-02-18 15:01:31,877 INFO [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(952): ClusterId : 1e8bde8e-f375-4bfa-89ec-60e7ba8f9cef 2023-02-18 15:01:31,877 DEBUG [RS:0;jenkins-hbase4:38837] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:31,877 DEBUG [RS:1;jenkins-hbase4:36479] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:31,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676732521879 2023-02-18 15:01:31,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 15:01:31,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 15:01:31,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 15:01:31,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 15:01:31,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 15:01:31,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 15:01:31,879 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:31,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,880 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 15:01:31,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 15:01:31,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 15:01:31,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 15:01:31,881 DEBUG [RS:0;jenkins-hbase4:38837] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:31,881 DEBUG [RS:0;jenkins-hbase4:38837] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:31,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 15:01:31,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 15:01:31,881 DEBUG [RS:1;jenkins-hbase4:36479] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:31,881 DEBUG [RS:1;jenkins-hbase4:36479] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:31,881 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:31,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732491881,5,FailOnTimeoutGroup] 2023-02-18 15:01:31,883 DEBUG [RS:0;jenkins-hbase4:38837] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:31,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732491882,5,FailOnTimeoutGroup] 2023-02-18 15:01:31,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,889 DEBUG [RS:1;jenkins-hbase4:36479] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:31,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 15:01:31,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,890 DEBUG [RS:0;jenkins-hbase4:38837] zookeeper.ReadOnlyZKClient(139): Connect 0x6f854efb to 127.0.0.1:61834 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:31,890 DEBUG [RS:1;jenkins-hbase4:36479] zookeeper.ReadOnlyZKClient(139): Connect 0x4bdf73ea to 127.0.0.1:61834 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:31,900 DEBUG [RS:0;jenkins-hbase4:38837] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6142ad7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:31,900 DEBUG [RS:1;jenkins-hbase4:36479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@451894e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:31,900 DEBUG [RS:0;jenkins-hbase4:38837] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@657d258b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:31,901 DEBUG [RS:1;jenkins-hbase4:36479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4127189a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:31,901 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:31,902 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:31,902 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905 2023-02-18 15:01:31,911 DEBUG [RS:0;jenkins-hbase4:38837] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38837 2023-02-18 15:01:31,911 INFO [RS:0;jenkins-hbase4:38837] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:31,911 INFO [RS:0;jenkins-hbase4:38837] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:31,911 DEBUG [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:31,911 INFO [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40113,1676732491599 with isa=jenkins-hbase4.apache.org/172.31.14.131:38837, startcode=1676732491639 2023-02-18 15:01:31,911 DEBUG [RS:0;jenkins-hbase4:38837] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:31,912 DEBUG [RS:1;jenkins-hbase4:36479] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36479 2023-02-18 15:01:31,912 INFO [RS:1;jenkins-hbase4:36479] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:31,912 INFO [RS:1;jenkins-hbase4:36479] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:31,912 DEBUG [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:31,912 INFO [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40113,1676732491599 with isa=jenkins-hbase4.apache.org/172.31.14.131:36479, startcode=1676732491663 2023-02-18 15:01:31,912 DEBUG [RS:1;jenkins-hbase4:36479] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:31,917 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39953, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:31,918 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35299, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:31,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40113] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:31,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:31,922 DEBUG [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905 2023-02-18 15:01:31,922 DEBUG [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905 2023-02-18 15:01:31,922 DEBUG [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45869 2023-02-18 15:01:31,922 DEBUG [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45869 2023-02-18 15:01:31,922 DEBUG [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:31,922 DEBUG [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:31,923 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:31,924 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:31,924 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:31,927 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/info 2023-02-18 15:01:31,927 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:31,927 DEBUG [RS:1;jenkins-hbase4:36479] zookeeper.ZKUtil(162): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:31,928 WARN [RS:1;jenkins-hbase4:36479] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:31,928 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36479,1676732491663] 2023-02-18 15:01:31,928 INFO [RS:1;jenkins-hbase4:36479] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:31,928 DEBUG [RS:0;jenkins-hbase4:38837] zookeeper.ZKUtil(162): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:31,928 DEBUG [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/WALs/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:31,928 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38837,1676732491639] 2023-02-18 15:01:31,928 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:31,928 WARN [RS:0;jenkins-hbase4:38837] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:31,928 INFO [RS:0;jenkins-hbase4:38837] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:31,928 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:31,928 DEBUG [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/WALs/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:31,931 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:31,932 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:31,933 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:31,933 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:31,933 DEBUG [RS:1;jenkins-hbase4:36479] zookeeper.ZKUtil(162): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:31,933 DEBUG [RS:0;jenkins-hbase4:38837] zookeeper.ZKUtil(162): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:31,933 DEBUG [RS:1;jenkins-hbase4:36479] zookeeper.ZKUtil(162): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:31,934 DEBUG [RS:0;jenkins-hbase4:38837] zookeeper.ZKUtil(162): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:31,934 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/table 2023-02-18 15:01:31,934 DEBUG [RS:1;jenkins-hbase4:36479] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:31,934 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:31,934 INFO [RS:1;jenkins-hbase4:36479] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:31,934 DEBUG [RS:0;jenkins-hbase4:38837] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:31,935 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:31,935 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740 2023-02-18 15:01:31,935 INFO [RS:0;jenkins-hbase4:38837] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:31,936 INFO [RS:1;jenkins-hbase4:36479] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:31,936 INFO [RS:1;jenkins-hbase4:36479] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:31,936 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740 2023-02-18 15:01:31,936 INFO [RS:1;jenkins-hbase4:36479] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,936 INFO [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:31,937 INFO [RS:0;jenkins-hbase4:38837] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:31,937 INFO [RS:1;jenkins-hbase4:36479] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,937 INFO [RS:0;jenkins-hbase4:38837] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:31,937 DEBUG [RS:1;jenkins-hbase4:36479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,937 INFO [RS:0;jenkins-hbase4:38837] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,938 DEBUG [RS:1;jenkins-hbase4:36479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,938 DEBUG [RS:1;jenkins-hbase4:36479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,938 DEBUG [RS:1;jenkins-hbase4:36479] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,938 INFO [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:31,938 DEBUG [RS:1;jenkins-hbase4:36479] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,938 DEBUG [RS:1;jenkins-hbase4:36479] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:31,939 DEBUG [RS:1;jenkins-hbase4:36479] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,939 DEBUG [RS:1;jenkins-hbase4:36479] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,939 DEBUG [RS:1;jenkins-hbase4:36479] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,939 DEBUG [RS:1;jenkins-hbase4:36479] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,939 INFO [RS:1;jenkins-hbase4:36479] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,939 INFO [RS:0;jenkins-hbase4:38837] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,940 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:31,940 DEBUG [RS:0;jenkins-hbase4:38837] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,940 INFO [RS:1;jenkins-hbase4:36479] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,940 DEBUG [RS:0;jenkins-hbase4:38837] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,940 INFO [RS:1;jenkins-hbase4:36479] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,940 DEBUG [RS:0;jenkins-hbase4:38837] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,940 DEBUG [RS:0;jenkins-hbase4:38837] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,940 DEBUG [RS:0;jenkins-hbase4:38837] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,940 DEBUG [RS:0;jenkins-hbase4:38837] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:31,940 DEBUG [RS:0;jenkins-hbase4:38837] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,940 DEBUG [RS:0;jenkins-hbase4:38837] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,940 DEBUG [RS:0;jenkins-hbase4:38837] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,940 DEBUG [RS:0;jenkins-hbase4:38837] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:31,941 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:31,945 INFO [RS:0;jenkins-hbase4:38837] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,945 INFO [RS:0;jenkins-hbase4:38837] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,945 INFO [RS:0;jenkins-hbase4:38837] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,948 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:31,948 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75486887, jitterRate=0.12484227120876312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:31,948 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:31,948 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:31,948 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:31,949 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:31,949 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:31,949 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:31,949 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:31,949 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:31,950 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:31,950 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 15:01:31,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 15:01:31,952 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 15:01:31,954 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 15:01:31,958 INFO [RS:1;jenkins-hbase4:36479] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:31,959 INFO [RS:1;jenkins-hbase4:36479] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36479,1676732491663-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,961 INFO [RS:0;jenkins-hbase4:38837] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:31,961 INFO [RS:0;jenkins-hbase4:38837] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38837,1676732491639-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:31,969 INFO [RS:1;jenkins-hbase4:36479] regionserver.Replication(203): jenkins-hbase4.apache.org,36479,1676732491663 started 2023-02-18 15:01:31,969 INFO [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36479,1676732491663, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36479, sessionid=0x10067f351010002 2023-02-18 15:01:31,969 DEBUG [RS:1;jenkins-hbase4:36479] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:31,969 DEBUG [RS:1;jenkins-hbase4:36479] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:31,969 DEBUG [RS:1;jenkins-hbase4:36479] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36479,1676732491663' 2023-02-18 15:01:31,969 DEBUG [RS:1;jenkins-hbase4:36479] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:31,969 DEBUG [RS:1;jenkins-hbase4:36479] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:31,969 DEBUG [RS:1;jenkins-hbase4:36479] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:31,969 DEBUG [RS:1;jenkins-hbase4:36479] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:31,970 DEBUG [RS:1;jenkins-hbase4:36479] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:31,970 DEBUG [RS:1;jenkins-hbase4:36479] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36479,1676732491663' 2023-02-18 15:01:31,970 DEBUG [RS:1;jenkins-hbase4:36479] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:31,970 DEBUG [RS:1;jenkins-hbase4:36479] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:31,970 DEBUG [RS:1;jenkins-hbase4:36479] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:31,970 INFO [RS:1;jenkins-hbase4:36479] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:31,970 INFO [RS:1;jenkins-hbase4:36479] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:31,971 INFO [RS:0;jenkins-hbase4:38837] regionserver.Replication(203): jenkins-hbase4.apache.org,38837,1676732491639 started 2023-02-18 15:01:31,971 INFO [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38837,1676732491639, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38837, sessionid=0x10067f351010001 2023-02-18 15:01:31,971 DEBUG [RS:0;jenkins-hbase4:38837] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:31,971 DEBUG [RS:0;jenkins-hbase4:38837] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:31,971 DEBUG [RS:0;jenkins-hbase4:38837] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38837,1676732491639' 2023-02-18 15:01:31,971 DEBUG [RS:0;jenkins-hbase4:38837] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:31,971 DEBUG [RS:0;jenkins-hbase4:38837] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:31,972 DEBUG [RS:0;jenkins-hbase4:38837] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:31,972 DEBUG [RS:0;jenkins-hbase4:38837] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:31,972 DEBUG [RS:0;jenkins-hbase4:38837] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:31,972 DEBUG [RS:0;jenkins-hbase4:38837] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38837,1676732491639' 2023-02-18 15:01:31,972 DEBUG [RS:0;jenkins-hbase4:38837] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:31,972 DEBUG [RS:0;jenkins-hbase4:38837] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:31,972 DEBUG [RS:0;jenkins-hbase4:38837] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:31,972 INFO [RS:0;jenkins-hbase4:38837] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:31,972 INFO [RS:0;jenkins-hbase4:38837] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:32,104 DEBUG [jenkins-hbase4:40113] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 15:01:32,104 DEBUG [jenkins-hbase4:40113] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:32,106 DEBUG [jenkins-hbase4:40113] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:32,106 DEBUG [jenkins-hbase4:40113] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:32,106 DEBUG [jenkins-hbase4:40113] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:32,107 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38837,1676732491639, state=OPENING 2023-02-18 15:01:32,109 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 15:01:32,110 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:32,111 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:32,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38837,1676732491639}] 2023-02-18 15:01:32,183 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 15:01:32,265 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:32,266 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:32,267 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58614, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:32,271 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 15:01:32,271 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:32,273 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38837%2C1676732491639.meta, suffix=.meta, logDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/WALs/jenkins-hbase4.apache.org,38837,1676732491639, archiveDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/oldWALs, maxLogs=32 2023-02-18 15:01:32,300 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36725,DS-90974e16-b120-4554-900c-b38a30739e2a,DISK] 2023-02-18 15:01:32,300 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42047,DS-bdee30af-1d20-4804-904a-c9f5327ad782,DISK] 2023-02-18 15:01:32,304 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/WALs/jenkins-hbase4.apache.org,38837,1676732491639/jenkins-hbase4.apache.org%2C38837%2C1676732491639.meta.1676732492273.meta 2023-02-18 15:01:32,304 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36725,DS-90974e16-b120-4554-900c-b38a30739e2a,DISK], DatanodeInfoWithStorage[127.0.0.1:42047,DS-bdee30af-1d20-4804-904a-c9f5327ad782,DISK]] 2023-02-18 15:01:32,304 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:32,305 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 15:01:32,305 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 15:01:32,305 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 15:01:32,305 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 15:01:32,305 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:32,305 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 15:01:32,305 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 15:01:32,306 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:32,307 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/info 2023-02-18 15:01:32,307 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/info 2023-02-18 15:01:32,308 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:32,308 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:32,308 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:32,309 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:32,309 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:32,310 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:32,310 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:32,310 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:32,311 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/table 2023-02-18 15:01:32,311 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/table 2023-02-18 15:01:32,311 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:32,311 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:32,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740 2023-02-18 15:01:32,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740 2023-02-18 15:01:32,315 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:32,316 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:32,317 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74084029, jitterRate=0.10393805801868439}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:32,317 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:32,319 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676732492265 2023-02-18 15:01:32,325 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 15:01:32,326 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 15:01:32,326 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38837,1676732491639, state=OPEN 2023-02-18 15:01:32,328 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 15:01:32,328 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:32,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 15:01:32,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38837,1676732491639 in 217 msec 2023-02-18 15:01:32,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 15:01:32,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 380 msec 2023-02-18 15:01:32,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 461 msec 2023-02-18 15:01:32,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676732492333, completionTime=-1 2023-02-18 15:01:32,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 15:01:32,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 15:01:32,340 DEBUG [hconnection-0x7cc4079d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:32,342 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58624, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:32,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 15:01:32,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676732552344 2023-02-18 15:01:32,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676732612344 2023-02-18 15:01:32,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 10 msec 2023-02-18 15:01:32,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40113,1676732491599-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:32,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40113,1676732491599-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:32,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40113,1676732491599-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:32,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40113, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:32,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:32,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 15:01:32,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:32,354 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 15:01:32,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 15:01:32,358 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:32,359 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:32,361 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1 2023-02-18 15:01:32,361 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1 empty. 2023-02-18 15:01:32,362 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1 2023-02-18 15:01:32,362 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 15:01:32,389 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:32,390 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6243c5abc898167a77b6ca10818e29c1, NAME => 'hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp 2023-02-18 15:01:32,407 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:32,407 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 6243c5abc898167a77b6ca10818e29c1, disabling compactions & flushes 2023-02-18 15:01:32,407 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:32,407 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:32,407 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. after waiting 0 ms 2023-02-18 15:01:32,407 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:32,407 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:32,407 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 6243c5abc898167a77b6ca10818e29c1: 2023-02-18 15:01:32,410 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:32,411 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732492411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732492411"}]},"ts":"1676732492411"} 2023-02-18 15:01:32,414 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 15:01:32,415 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:32,415 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732492415"}]},"ts":"1676732492415"} 2023-02-18 15:01:32,417 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 15:01:32,420 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:32,421 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:32,421 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:32,421 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:32,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6243c5abc898167a77b6ca10818e29c1, ASSIGN}] 2023-02-18 15:01:32,429 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6243c5abc898167a77b6ca10818e29c1, ASSIGN 2023-02-18 15:01:32,430 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6243c5abc898167a77b6ca10818e29c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36479,1676732491663; forceNewPlan=false, retain=false 2023-02-18 15:01:32,580 INFO [jenkins-hbase4:40113] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 15:01:32,584 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6243c5abc898167a77b6ca10818e29c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:32,585 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732492584"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732492584"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732492584"}]},"ts":"1676732492584"} 2023-02-18 15:01:32,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6243c5abc898167a77b6ca10818e29c1, server=jenkins-hbase4.apache.org,36479,1676732491663}] 2023-02-18 15:01:32,741 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:32,741 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:32,742 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51320, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:32,746 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:32,747 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36479%2C1676732491663, suffix=, logDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/WALs/jenkins-hbase4.apache.org,36479,1676732491663, archiveDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/oldWALs, maxLogs=32 2023-02-18 15:01:32,761 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36725,DS-90974e16-b120-4554-900c-b38a30739e2a,DISK] 2023-02-18 15:01:32,761 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42047,DS-bdee30af-1d20-4804-904a-c9f5327ad782,DISK] 2023-02-18 15:01:32,764 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/WALs/jenkins-hbase4.apache.org,36479,1676732491663/jenkins-hbase4.apache.org%2C36479%2C1676732491663.1676732492747 2023-02-18 15:01:32,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36725,DS-90974e16-b120-4554-900c-b38a30739e2a,DISK], DatanodeInfoWithStorage[127.0.0.1:42047,DS-bdee30af-1d20-4804-904a-c9f5327ad782,DISK]] 2023-02-18 15:01:32,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6243c5abc898167a77b6ca10818e29c1, NAME => 'hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:32,765 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6243c5abc898167a77b6ca10818e29c1 2023-02-18 15:01:32,765 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:32,765 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6243c5abc898167a77b6ca10818e29c1 2023-02-18 15:01:32,765 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6243c5abc898167a77b6ca10818e29c1 2023-02-18 15:01:32,768 INFO [StoreOpener-6243c5abc898167a77b6ca10818e29c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6243c5abc898167a77b6ca10818e29c1 2023-02-18 15:01:32,769 DEBUG [StoreOpener-6243c5abc898167a77b6ca10818e29c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1/info 2023-02-18 15:01:32,769 DEBUG [StoreOpener-6243c5abc898167a77b6ca10818e29c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1/info 2023-02-18 15:01:32,769 INFO [StoreOpener-6243c5abc898167a77b6ca10818e29c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6243c5abc898167a77b6ca10818e29c1 columnFamilyName info 2023-02-18 15:01:32,770 INFO [StoreOpener-6243c5abc898167a77b6ca10818e29c1-1] regionserver.HStore(310): Store=6243c5abc898167a77b6ca10818e29c1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:32,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1 2023-02-18 15:01:32,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1 2023-02-18 15:01:32,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6243c5abc898167a77b6ca10818e29c1 2023-02-18 15:01:32,774 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:32,775 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6243c5abc898167a77b6ca10818e29c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70586452, jitterRate=0.05182009935379028}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:32,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6243c5abc898167a77b6ca10818e29c1: 2023-02-18 15:01:32,775 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1., pid=6, masterSystemTime=1676732492741 2023-02-18 15:01:32,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:32,779 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:32,779 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6243c5abc898167a77b6ca10818e29c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:32,780 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732492779"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732492779"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732492779"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732492779"}]},"ts":"1676732492779"} 2023-02-18 15:01:32,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 15:01:32,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6243c5abc898167a77b6ca10818e29c1, server=jenkins-hbase4.apache.org,36479,1676732491663 in 192 msec 2023-02-18 15:01:32,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 15:01:32,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6243c5abc898167a77b6ca10818e29c1, ASSIGN in 361 msec 2023-02-18 15:01:32,785 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:32,785 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732492785"}]},"ts":"1676732492785"} 2023-02-18 15:01:32,787 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 15:01:32,789 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:32,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 436 msec 2023-02-18 15:01:32,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 15:01:32,860 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:32,860 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:32,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:32,863 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51326, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:32,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 15:01:32,873 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:32,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-18 15:01:32,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 15:01:32,883 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:32,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-18 15:01:32,890 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 15:01:32,893 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 15:01:32,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.209sec 2023-02-18 15:01:32,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 15:01:32,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 15:01:32,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 15:01:32,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40113,1676732491599-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 15:01:32,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40113,1676732491599-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 15:01:32,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 15:01:32,974 INFO [RS:0;jenkins-hbase4:38837] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38837%2C1676732491639, suffix=, logDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/WALs/jenkins-hbase4.apache.org,38837,1676732491639, archiveDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/oldWALs, maxLogs=32 2023-02-18 15:01:32,980 DEBUG [Listener at localhost/41495] zookeeper.ReadOnlyZKClient(139): Connect 0x65bb1be1 to 127.0.0.1:61834 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:32,986 DEBUG [Listener at localhost/41495] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1916d80b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:32,992 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42047,DS-bdee30af-1d20-4804-904a-c9f5327ad782,DISK] 2023-02-18 15:01:32,992 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36725,DS-90974e16-b120-4554-900c-b38a30739e2a,DISK] 2023-02-18 15:01:32,998 DEBUG [hconnection-0x15a434f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:33,000 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58632, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:33,000 INFO [RS:0;jenkins-hbase4:38837] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/WALs/jenkins-hbase4.apache.org,38837,1676732491639/jenkins-hbase4.apache.org%2C38837%2C1676732491639.1676732492974 2023-02-18 15:01:33,001 DEBUG [RS:0;jenkins-hbase4:38837] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36725,DS-90974e16-b120-4554-900c-b38a30739e2a,DISK], DatanodeInfoWithStorage[127.0.0.1:42047,DS-bdee30af-1d20-4804-904a-c9f5327ad782,DISK]] 2023-02-18 15:01:33,001 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40113,1676732491599 2023-02-18 15:01:33,001 DEBUG [Listener at localhost/41495] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 15:01:33,003 DEBUG [Listener at localhost/41495] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 15:01:33,005 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58046, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 15:01:33,005 INFO [Listener at localhost/41495] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-18 15:01:33,006 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-18 15:01:33,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 15:01:33,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:58046 deadline: 1676732553006, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-18 15:01:33,007 INFO [Listener at localhost/41495] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-18 15:01:33,009 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:33,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:33,011 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:33,012 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-18 15:01:33,012 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:33,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:33,019 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:33,019 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:33,019 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:33,019 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:33,019 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:33,019 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:33,019 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:33,020 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f empty. 2023-02-18 15:01:33,019 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:33,020 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4 empty. 2023-02-18 15:01:33,020 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70 empty. 2023-02-18 15:01:33,020 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5 empty. 2023-02-18 15:01:33,020 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e empty. 2023-02-18 15:01:33,020 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996 empty. 2023-02-18 15:01:33,020 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:33,020 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:33,020 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:33,020 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:33,021 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:33,021 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4 empty. 2023-02-18 15:01:33,021 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03 empty. 2023-02-18 15:01:33,021 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:33,021 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:33,021 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:33,021 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:33,021 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f empty. 2023-02-18 15:01:33,021 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c empty. 2023-02-18 15:01:33,021 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:33,021 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:33,022 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:33,022 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-18 15:01:33,029 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:33,031 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2ac5ba9e0adcd5edd0f46077da3de996, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp 2023-02-18 15:01:33,031 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 60fcf24038136da91c1222b466e62c4f, NAME => 'testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp 2023-02-18 15:01:33,031 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5d55cd0811e64abcd9e6fa58191b0fd4, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp 2023-02-18 15:01:33,037 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,037 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 60fcf24038136da91c1222b466e62c4f, disabling compactions & flushes 2023-02-18 15:01:33,037 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:33,037 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:33,037 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. after waiting 0 ms 2023-02-18 15:01:33,038 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:33,038 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:33,038 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 60fcf24038136da91c1222b466e62c4f: 2023-02-18 15:01:33,038 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => eb11a992c540b181cd13c8a05f341a03, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp 2023-02-18 15:01:33,038 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,038 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 5d55cd0811e64abcd9e6fa58191b0fd4, disabling compactions & flushes 2023-02-18 15:01:33,038 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:33,038 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:33,038 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. after waiting 0 ms 2023-02-18 15:01:33,038 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:33,038 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:33,038 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 5d55cd0811e64abcd9e6fa58191b0fd4: 2023-02-18 15:01:33,039 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => f38c2b0d8bdfee48c79d8e2e48e87f70, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp 2023-02-18 15:01:33,039 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,039 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 2ac5ba9e0adcd5edd0f46077da3de996, disabling compactions & flushes 2023-02-18 15:01:33,039 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:33,039 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:33,039 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. after waiting 0 ms 2023-02-18 15:01:33,039 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:33,039 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:33,039 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 2ac5ba9e0adcd5edd0f46077da3de996: 2023-02-18 15:01:33,040 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => d097efb1ca5f85b18f735c9483e312b5, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp 2023-02-18 15:01:33,053 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,053 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing eb11a992c540b181cd13c8a05f341a03, disabling compactions & flushes 2023-02-18 15:01:33,053 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:33,053 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:33,054 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. after waiting 1 ms 2023-02-18 15:01:33,054 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:33,054 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:33,054 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for eb11a992c540b181cd13c8a05f341a03: 2023-02-18 15:01:33,054 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,054 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing f38c2b0d8bdfee48c79d8e2e48e87f70, disabling compactions & flushes 2023-02-18 15:01:33,054 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:33,054 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:33,054 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => cf5bdeb8bb5eb132408d6e2daa4817d4, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp 2023-02-18 15:01:33,054 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. after waiting 0 ms 2023-02-18 15:01:33,054 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:33,054 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:33,054 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for f38c2b0d8bdfee48c79d8e2e48e87f70: 2023-02-18 15:01:33,055 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => f00f071a5b247f9c69489550eafadf7e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp 2023-02-18 15:01:33,055 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,055 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing d097efb1ca5f85b18f735c9483e312b5, disabling compactions & flushes 2023-02-18 15:01:33,055 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:33,055 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:33,055 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. after waiting 0 ms 2023-02-18 15:01:33,055 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:33,055 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:33,055 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for d097efb1ca5f85b18f735c9483e312b5: 2023-02-18 15:01:33,055 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => d3e65d483df1348874accc9495c2f30c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp 2023-02-18 15:01:33,072 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,072 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing cf5bdeb8bb5eb132408d6e2daa4817d4, disabling compactions & flushes 2023-02-18 15:01:33,072 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:33,072 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:33,072 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. after waiting 0 ms 2023-02-18 15:01:33,072 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:33,072 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:33,072 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for cf5bdeb8bb5eb132408d6e2daa4817d4: 2023-02-18 15:01:33,072 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3dc6e1c27e3ffcaf5419a0eac034619f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp 2023-02-18 15:01:33,073 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,073 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing d3e65d483df1348874accc9495c2f30c, disabling compactions & flushes 2023-02-18 15:01:33,073 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:33,073 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:33,073 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. after waiting 0 ms 2023-02-18 15:01:33,073 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:33,073 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:33,073 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for d3e65d483df1348874accc9495c2f30c: 2023-02-18 15:01:33,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 3dc6e1c27e3ffcaf5419a0eac034619f, disabling compactions & flushes 2023-02-18 15:01:33,078 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:33,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:33,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. after waiting 0 ms 2023-02-18 15:01:33,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:33,078 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:33,078 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3dc6e1c27e3ffcaf5419a0eac034619f: 2023-02-18 15:01:33,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:33,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:33,472 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,473 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing f00f071a5b247f9c69489550eafadf7e, disabling compactions & flushes 2023-02-18 15:01:33,473 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:33,473 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:33,473 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. after waiting 0 ms 2023-02-18 15:01:33,473 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:33,473 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:33,473 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for f00f071a5b247f9c69489550eafadf7e: 2023-02-18 15:01:33,475 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:33,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676732493476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732493476"}]},"ts":"1676732493476"} 2023-02-18 15:01:33,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732493476"}]},"ts":"1676732493476"} 2023-02-18 15:01:33,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732493476"}]},"ts":"1676732493476"} 2023-02-18 15:01:33,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732493476"}]},"ts":"1676732493476"} 2023-02-18 15:01:33,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732493476"}]},"ts":"1676732493476"} 2023-02-18 15:01:33,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732493476"}]},"ts":"1676732493476"} 2023-02-18 15:01:33,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732493476"}]},"ts":"1676732493476"} 2023-02-18 15:01:33,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732493476"}]},"ts":"1676732493476"} 2023-02-18 15:01:33,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676732493476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732493476"}]},"ts":"1676732493476"} 2023-02-18 15:01:33,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732493476"}]},"ts":"1676732493476"} 2023-02-18 15:01:33,478 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-18 15:01:33,479 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:33,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732493479"}]},"ts":"1676732493479"} 2023-02-18 15:01:33,480 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-18 15:01:33,483 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:33,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:33,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:33,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:33,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=60fcf24038136da91c1222b466e62c4f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d55cd0811e64abcd9e6fa58191b0fd4, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ac5ba9e0adcd5edd0f46077da3de996, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb11a992c540b181cd13c8a05f341a03, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f38c2b0d8bdfee48c79d8e2e48e87f70, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d097efb1ca5f85b18f735c9483e312b5, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cf5bdeb8bb5eb132408d6e2daa4817d4, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f00f071a5b247f9c69489550eafadf7e, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d3e65d483df1348874accc9495c2f30c, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3dc6e1c27e3ffcaf5419a0eac034619f, ASSIGN}] 2023-02-18 15:01:33,492 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d55cd0811e64abcd9e6fa58191b0fd4, ASSIGN 2023-02-18 15:01:33,492 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb11a992c540b181cd13c8a05f341a03, ASSIGN 2023-02-18 15:01:33,492 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f38c2b0d8bdfee48c79d8e2e48e87f70, ASSIGN 2023-02-18 15:01:33,492 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ac5ba9e0adcd5edd0f46077da3de996, ASSIGN 2023-02-18 15:01:33,492 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d55cd0811e64abcd9e6fa58191b0fd4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38837,1676732491639; forceNewPlan=false, retain=false 2023-02-18 15:01:33,493 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb11a992c540b181cd13c8a05f341a03, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38837,1676732491639; forceNewPlan=false, retain=false 2023-02-18 15:01:33,493 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f38c2b0d8bdfee48c79d8e2e48e87f70, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36479,1676732491663; forceNewPlan=false, retain=false 2023-02-18 15:01:33,493 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3dc6e1c27e3ffcaf5419a0eac034619f, ASSIGN 2023-02-18 15:01:33,493 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ac5ba9e0adcd5edd0f46077da3de996, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36479,1676732491663; forceNewPlan=false, retain=false 2023-02-18 15:01:33,493 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d3e65d483df1348874accc9495c2f30c, ASSIGN 2023-02-18 15:01:33,493 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f00f071a5b247f9c69489550eafadf7e, ASSIGN 2023-02-18 15:01:33,494 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cf5bdeb8bb5eb132408d6e2daa4817d4, ASSIGN 2023-02-18 15:01:33,494 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3dc6e1c27e3ffcaf5419a0eac034619f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36479,1676732491663; forceNewPlan=false, retain=false 2023-02-18 15:01:33,495 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d097efb1ca5f85b18f735c9483e312b5, ASSIGN 2023-02-18 15:01:33,494 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f00f071a5b247f9c69489550eafadf7e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38837,1676732491639; forceNewPlan=false, retain=false 2023-02-18 15:01:33,494 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d3e65d483df1348874accc9495c2f30c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38837,1676732491639; forceNewPlan=false, retain=false 2023-02-18 15:01:33,495 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cf5bdeb8bb5eb132408d6e2daa4817d4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36479,1676732491663; forceNewPlan=false, retain=false 2023-02-18 15:01:33,495 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=60fcf24038136da91c1222b466e62c4f, ASSIGN 2023-02-18 15:01:33,495 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d097efb1ca5f85b18f735c9483e312b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38837,1676732491639; forceNewPlan=false, retain=false 2023-02-18 15:01:33,496 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=60fcf24038136da91c1222b466e62c4f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36479,1676732491663; forceNewPlan=false, retain=false 2023-02-18 15:01:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:33,643 INFO [jenkins-hbase4:40113] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-18 15:01:33,649 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d3e65d483df1348874accc9495c2f30c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:33,649 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=eb11a992c540b181cd13c8a05f341a03, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:33,649 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732493649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732493649"}]},"ts":"1676732493649"} 2023-02-18 15:01:33,649 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d097efb1ca5f85b18f735c9483e312b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:33,649 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=f00f071a5b247f9c69489550eafadf7e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:33,649 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5d55cd0811e64abcd9e6fa58191b0fd4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:33,650 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732493649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732493649"}]},"ts":"1676732493649"} 2023-02-18 15:01:33,650 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732493649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732493649"}]},"ts":"1676732493649"} 2023-02-18 15:01:33,650 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732493649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732493649"}]},"ts":"1676732493649"} 2023-02-18 15:01:33,650 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732493649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732493649"}]},"ts":"1676732493649"} 2023-02-18 15:01:33,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure d3e65d483df1348874accc9495c2f30c, server=jenkins-hbase4.apache.org,38837,1676732491639}] 2023-02-18 15:01:33,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE; OpenRegionProcedure f00f071a5b247f9c69489550eafadf7e, server=jenkins-hbase4.apache.org,38837,1676732491639}] 2023-02-18 15:01:33,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=16, state=RUNNABLE; OpenRegionProcedure d097efb1ca5f85b18f735c9483e312b5, server=jenkins-hbase4.apache.org,38837,1676732491639}] 2023-02-18 15:01:33,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure eb11a992c540b181cd13c8a05f341a03, server=jenkins-hbase4.apache.org,38837,1676732491639}] 2023-02-18 15:01:33,654 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=60fcf24038136da91c1222b466e62c4f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:33,654 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676732493654"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732493654"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732493654"}]},"ts":"1676732493654"} 2023-02-18 15:01:33,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=12, state=RUNNABLE; OpenRegionProcedure 5d55cd0811e64abcd9e6fa58191b0fd4, server=jenkins-hbase4.apache.org,38837,1676732491639}] 2023-02-18 15:01:33,655 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3dc6e1c27e3ffcaf5419a0eac034619f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:33,655 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676732493655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732493655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732493655"}]},"ts":"1676732493655"} 2023-02-18 15:01:33,655 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f38c2b0d8bdfee48c79d8e2e48e87f70, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:33,656 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732493655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732493655"}]},"ts":"1676732493655"} 2023-02-18 15:01:33,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=11, state=RUNNABLE; OpenRegionProcedure 60fcf24038136da91c1222b466e62c4f, server=jenkins-hbase4.apache.org,36479,1676732491663}] 2023-02-18 15:01:33,656 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=cf5bdeb8bb5eb132408d6e2daa4817d4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:33,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure 3dc6e1c27e3ffcaf5419a0eac034619f, server=jenkins-hbase4.apache.org,36479,1676732491663}] 2023-02-18 15:01:33,656 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732493656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732493656"}]},"ts":"1676732493656"} 2023-02-18 15:01:33,657 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2ac5ba9e0adcd5edd0f46077da3de996, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:33,657 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493657"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732493657"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732493657"}]},"ts":"1676732493657"} 2023-02-18 15:01:33,657 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=15, state=RUNNABLE; OpenRegionProcedure f38c2b0d8bdfee48c79d8e2e48e87f70, server=jenkins-hbase4.apache.org,36479,1676732491663}] 2023-02-18 15:01:33,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=17, state=RUNNABLE; OpenRegionProcedure cf5bdeb8bb5eb132408d6e2daa4817d4, server=jenkins-hbase4.apache.org,36479,1676732491663}] 2023-02-18 15:01:33,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure 2ac5ba9e0adcd5edd0f46077da3de996, server=jenkins-hbase4.apache.org,36479,1676732491663}] 2023-02-18 15:01:33,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:33,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d3e65d483df1348874accc9495c2f30c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-18 15:01:33,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:33,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:33,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:33,808 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:33,809 DEBUG [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1 2023-02-18 15:01:33,809 DEBUG [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1 2023-02-18 15:01:33,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:33,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2ac5ba9e0adcd5edd0f46077da3de996, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-18 15:01:33,810 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3e65d483df1348874accc9495c2f30c columnFamilyName f1 2023-02-18 15:01:33,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:33,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:33,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:33,810 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] regionserver.HStore(310): Store=d3e65d483df1348874accc9495c2f30c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,810 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:33,811 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:33,812 DEBUG [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2 2023-02-18 15:01:33,812 DEBUG [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2 2023-02-18 15:01:33,812 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3e65d483df1348874accc9495c2f30c columnFamilyName f2 2023-02-18 15:01:33,812 DEBUG [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1 2023-02-18 15:01:33,812 DEBUG [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1 2023-02-18 15:01:33,813 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ac5ba9e0adcd5edd0f46077da3de996 columnFamilyName f1 2023-02-18 15:01:33,813 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] regionserver.HStore(310): Store=d3e65d483df1348874accc9495c2f30c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,813 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] regionserver.HStore(310): Store=2ac5ba9e0adcd5edd0f46077da3de996/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,813 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:33,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:33,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:33,814 DEBUG [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2 2023-02-18 15:01:33,814 DEBUG [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2 2023-02-18 15:01:33,814 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ac5ba9e0adcd5edd0f46077da3de996 columnFamilyName f2 2023-02-18 15:01:33,815 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] regionserver.HStore(310): Store=2ac5ba9e0adcd5edd0f46077da3de996/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:33,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:33,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:33,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:33,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:33,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:33,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:33,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d3e65d483df1348874accc9495c2f30c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59323172, jitterRate=-0.11601585149765015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:33,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d3e65d483df1348874accc9495c2f30c: 2023-02-18 15:01:33,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:33,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c., pid=21, masterSystemTime=1676732493803 2023-02-18 15:01:33,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2ac5ba9e0adcd5edd0f46077da3de996; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71254941, jitterRate=0.06178136169910431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:33,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2ac5ba9e0adcd5edd0f46077da3de996: 2023-02-18 15:01:33,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996., pid=30, masterSystemTime=1676732493807 2023-02-18 15:01:33,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:33,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:33,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:33,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f00f071a5b247f9c69489550eafadf7e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-18 15:01:33,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:33,823 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d3e65d483df1348874accc9495c2f30c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:33,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,824 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493823"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732493823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732493823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732493823"}]},"ts":"1676732493823"} 2023-02-18 15:01:33,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:33,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:33,824 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2ac5ba9e0adcd5edd0f46077da3de996, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:33,825 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493824"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732493824"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732493824"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732493824"}]},"ts":"1676732493824"} 2023-02-18 15:01:33,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:33,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:33,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:33,825 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:33,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cf5bdeb8bb5eb132408d6e2daa4817d4, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-18 15:01:33,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:33,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:33,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:33,827 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:33,827 DEBUG [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1 2023-02-18 15:01:33,828 DEBUG [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1 2023-02-18 15:01:33,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-18 15:01:33,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure d3e65d483df1348874accc9495c2f30c, server=jenkins-hbase4.apache.org,38837,1676732491639 in 175 msec 2023-02-18 15:01:33,828 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f00f071a5b247f9c69489550eafadf7e columnFamilyName f1 2023-02-18 15:01:33,829 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] regionserver.HStore(310): Store=f00f071a5b247f9c69489550eafadf7e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,829 DEBUG [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1 2023-02-18 15:01:33,829 DEBUG [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1 2023-02-18 15:01:33,829 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:33,829 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf5bdeb8bb5eb132408d6e2daa4817d4 columnFamilyName f1 2023-02-18 15:01:33,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-18 15:01:33,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure 2ac5ba9e0adcd5edd0f46077da3de996, server=jenkins-hbase4.apache.org,36479,1676732491663 in 169 msec 2023-02-18 15:01:33,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d3e65d483df1348874accc9495c2f30c, ASSIGN in 338 msec 2023-02-18 15:01:33,830 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] regionserver.HStore(310): Store=cf5bdeb8bb5eb132408d6e2daa4817d4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,830 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:33,830 DEBUG [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2 2023-02-18 15:01:33,830 DEBUG [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2 2023-02-18 15:01:33,830 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f00f071a5b247f9c69489550eafadf7e columnFamilyName f2 2023-02-18 15:01:33,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ac5ba9e0adcd5edd0f46077da3de996, ASSIGN in 340 msec 2023-02-18 15:01:33,831 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] regionserver.HStore(310): Store=f00f071a5b247f9c69489550eafadf7e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,831 DEBUG [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2 2023-02-18 15:01:33,831 DEBUG [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2 2023-02-18 15:01:33,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:33,832 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf5bdeb8bb5eb132408d6e2daa4817d4 columnFamilyName f2 2023-02-18 15:01:33,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:33,832 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] regionserver.HStore(310): Store=cf5bdeb8bb5eb132408d6e2daa4817d4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:33,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:33,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:33,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:33,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:33,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:33,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:33,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f00f071a5b247f9c69489550eafadf7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65536812, jitterRate=-0.023425400257110596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:33,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f00f071a5b247f9c69489550eafadf7e: 2023-02-18 15:01:33,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:33,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e., pid=22, masterSystemTime=1676732493803 2023-02-18 15:01:33,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cf5bdeb8bb5eb132408d6e2daa4817d4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63810338, jitterRate=-0.049151867628097534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:33,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cf5bdeb8bb5eb132408d6e2daa4817d4: 2023-02-18 15:01:33,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4., pid=29, masterSystemTime=1676732493807 2023-02-18 15:01:33,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:33,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:33,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:33,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5d55cd0811e64abcd9e6fa58191b0fd4, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-18 15:01:33,840 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=f00f071a5b247f9c69489550eafadf7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:33,840 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493840"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732493840"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732493840"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732493840"}]},"ts":"1676732493840"} 2023-02-18 15:01:33,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:33,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:33,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:33,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:33,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:33,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:33,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3dc6e1c27e3ffcaf5419a0eac034619f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-18 15:01:33,841 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=cf5bdeb8bb5eb132408d6e2daa4817d4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:33,841 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493841"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732493841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732493841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732493841"}]},"ts":"1676732493841"} 2023-02-18 15:01:33,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:33,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:33,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:33,842 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:33,842 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:33,843 DEBUG [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1 2023-02-18 15:01:33,843 DEBUG [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1 2023-02-18 15:01:33,844 DEBUG [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/f1 2023-02-18 15:01:33,844 DEBUG [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/f1 2023-02-18 15:01:33,844 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d55cd0811e64abcd9e6fa58191b0fd4 columnFamilyName f1 2023-02-18 15:01:33,844 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3dc6e1c27e3ffcaf5419a0eac034619f columnFamilyName f1 2023-02-18 15:01:33,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-02-18 15:01:33,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; OpenRegionProcedure f00f071a5b247f9c69489550eafadf7e, server=jenkins-hbase4.apache.org,38837,1676732491639 in 190 msec 2023-02-18 15:01:33,844 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] regionserver.HStore(310): Store=5d55cd0811e64abcd9e6fa58191b0fd4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=17 2023-02-18 15:01:33,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=17, state=SUCCESS; OpenRegionProcedure cf5bdeb8bb5eb132408d6e2daa4817d4, server=jenkins-hbase4.apache.org,36479,1676732491663 in 185 msec 2023-02-18 15:01:33,845 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] regionserver.HStore(310): Store=3dc6e1c27e3ffcaf5419a0eac034619f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,845 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:33,845 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:33,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f00f071a5b247f9c69489550eafadf7e, ASSIGN in 354 msec 2023-02-18 15:01:33,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cf5bdeb8bb5eb132408d6e2daa4817d4, ASSIGN in 355 msec 2023-02-18 15:01:33,846 DEBUG [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2 2023-02-18 15:01:33,846 DEBUG [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2 2023-02-18 15:01:33,846 DEBUG [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/f2 2023-02-18 15:01:33,846 DEBUG [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/f2 2023-02-18 15:01:33,846 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d55cd0811e64abcd9e6fa58191b0fd4 columnFamilyName f2 2023-02-18 15:01:33,847 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3dc6e1c27e3ffcaf5419a0eac034619f columnFamilyName f2 2023-02-18 15:01:33,847 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] regionserver.HStore(310): Store=5d55cd0811e64abcd9e6fa58191b0fd4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,847 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] regionserver.HStore(310): Store=3dc6e1c27e3ffcaf5419a0eac034619f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:33,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:33,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:33,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:33,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:33,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:33,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:33,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:33,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:33,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:33,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3dc6e1c27e3ffcaf5419a0eac034619f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73295374, jitterRate=0.09218618273735046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:33,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3dc6e1c27e3ffcaf5419a0eac034619f: 2023-02-18 15:01:33,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5d55cd0811e64abcd9e6fa58191b0fd4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62746242, jitterRate=-0.06500813364982605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:33,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5d55cd0811e64abcd9e6fa58191b0fd4: 2023-02-18 15:01:33,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f., pid=27, masterSystemTime=1676732493807 2023-02-18 15:01:33,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4., pid=25, masterSystemTime=1676732493803 2023-02-18 15:01:33,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:33,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:33,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:33,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f38c2b0d8bdfee48c79d8e2e48e87f70, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-18 15:01:33,855 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3dc6e1c27e3ffcaf5419a0eac034619f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:33,855 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676732493855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732493855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732493855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732493855"}]},"ts":"1676732493855"} 2023-02-18 15:01:33,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:33,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:33,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:33,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:33,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:33,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:33,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => eb11a992c540b181cd13c8a05f341a03, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-18 15:01:33,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:33,857 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5d55cd0811e64abcd9e6fa58191b0fd4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:33,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:33,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:33,857 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493856"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732493856"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732493856"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732493856"}]},"ts":"1676732493856"} 2023-02-18 15:01:33,857 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:33,858 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:33,858 DEBUG [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1 2023-02-18 15:01:33,858 DEBUG [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1 2023-02-18 15:01:33,859 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f38c2b0d8bdfee48c79d8e2e48e87f70 columnFamilyName f1 2023-02-18 15:01:33,859 DEBUG [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1 2023-02-18 15:01:33,859 DEBUG [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1 2023-02-18 15:01:33,859 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] regionserver.HStore(310): Store=f38c2b0d8bdfee48c79d8e2e48e87f70/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,859 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb11a992c540b181cd13c8a05f341a03 columnFamilyName f1 2023-02-18 15:01:33,859 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:33,860 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] regionserver.HStore(310): Store=eb11a992c540b181cd13c8a05f341a03/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,860 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:33,861 DEBUG [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2 2023-02-18 15:01:33,861 DEBUG [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2 2023-02-18 15:01:33,861 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f38c2b0d8bdfee48c79d8e2e48e87f70 columnFamilyName f2 2023-02-18 15:01:33,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-18 15:01:33,861 DEBUG [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2 2023-02-18 15:01:33,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=12 2023-02-18 15:01:33,861 DEBUG [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2 2023-02-18 15:01:33,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure 3dc6e1c27e3ffcaf5419a0eac034619f, server=jenkins-hbase4.apache.org,36479,1676732491663 in 201 msec 2023-02-18 15:01:33,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=12, state=SUCCESS; OpenRegionProcedure 5d55cd0811e64abcd9e6fa58191b0fd4, server=jenkins-hbase4.apache.org,38837,1676732491639 in 204 msec 2023-02-18 15:01:33,861 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] regionserver.HStore(310): Store=f38c2b0d8bdfee48c79d8e2e48e87f70/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,862 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb11a992c540b181cd13c8a05f341a03 columnFamilyName f2 2023-02-18 15:01:33,862 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] regionserver.HStore(310): Store=eb11a992c540b181cd13c8a05f341a03/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:33,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d55cd0811e64abcd9e6fa58191b0fd4, ASSIGN in 371 msec 2023-02-18 15:01:33,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:33,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3dc6e1c27e3ffcaf5419a0eac034619f, ASSIGN in 371 msec 2023-02-18 15:01:33,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:33,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:33,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:33,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:33,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:33,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:33,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:33,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:33,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f38c2b0d8bdfee48c79d8e2e48e87f70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73625991, jitterRate=0.0971127599477768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:33,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened eb11a992c540b181cd13c8a05f341a03; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64295998, jitterRate=-0.04191496968269348}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:33,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f38c2b0d8bdfee48c79d8e2e48e87f70: 2023-02-18 15:01:33,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for eb11a992c540b181cd13c8a05f341a03: 2023-02-18 15:01:33,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03., pid=24, masterSystemTime=1676732493803 2023-02-18 15:01:33,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70., pid=28, masterSystemTime=1676732493807 2023-02-18 15:01:33,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:33,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:33,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:33,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 60fcf24038136da91c1222b466e62c4f, NAME => 'testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-18 15:01:33,872 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f38c2b0d8bdfee48c79d8e2e48e87f70, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:33,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:33,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,872 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493872"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732493872"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732493872"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732493872"}]},"ts":"1676732493872"} 2023-02-18 15:01:33,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:33,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:33,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:33,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:33,872 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=eb11a992c540b181cd13c8a05f341a03, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:33,872 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493872"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732493872"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732493872"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732493872"}]},"ts":"1676732493872"} 2023-02-18 15:01:33,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:33,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d097efb1ca5f85b18f735c9483e312b5, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-18 15:01:33,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:33,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:33,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:33,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:33,874 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:33,874 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:33,876 DEBUG [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/f1 2023-02-18 15:01:33,876 DEBUG [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/f1 2023-02-18 15:01:33,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=15 2023-02-18 15:01:33,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=15, state=SUCCESS; OpenRegionProcedure f38c2b0d8bdfee48c79d8e2e48e87f70, server=jenkins-hbase4.apache.org,36479,1676732491663 in 217 msec 2023-02-18 15:01:33,876 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60fcf24038136da91c1222b466e62c4f columnFamilyName f1 2023-02-18 15:01:33,876 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] regionserver.HStore(310): Store=60fcf24038136da91c1222b466e62c4f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-18 15:01:33,877 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:33,877 DEBUG [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1 2023-02-18 15:01:33,877 DEBUG [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1 2023-02-18 15:01:33,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure eb11a992c540b181cd13c8a05f341a03, server=jenkins-hbase4.apache.org,38837,1676732491639 in 220 msec 2023-02-18 15:01:33,877 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d097efb1ca5f85b18f735c9483e312b5 columnFamilyName f1 2023-02-18 15:01:33,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f38c2b0d8bdfee48c79d8e2e48e87f70, ASSIGN in 386 msec 2023-02-18 15:01:33,878 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] regionserver.HStore(310): Store=d097efb1ca5f85b18f735c9483e312b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,878 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:33,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb11a992c540b181cd13c8a05f341a03, ASSIGN in 387 msec 2023-02-18 15:01:33,878 DEBUG [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/f2 2023-02-18 15:01:33,878 DEBUG [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/f2 2023-02-18 15:01:33,878 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60fcf24038136da91c1222b466e62c4f columnFamilyName f2 2023-02-18 15:01:33,879 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] regionserver.HStore(310): Store=60fcf24038136da91c1222b466e62c4f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,879 DEBUG [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2 2023-02-18 15:01:33,879 DEBUG [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2 2023-02-18 15:01:33,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:33,879 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d097efb1ca5f85b18f735c9483e312b5 columnFamilyName f2 2023-02-18 15:01:33,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:33,880 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] regionserver.HStore(310): Store=d097efb1ca5f85b18f735c9483e312b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:33,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:33,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:33,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:33,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:33,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:33,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 60fcf24038136da91c1222b466e62c4f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59456349, jitterRate=-0.1140313595533371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:33,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 60fcf24038136da91c1222b466e62c4f: 2023-02-18 15:01:33,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f., pid=26, masterSystemTime=1676732493807 2023-02-18 15:01:33,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:33,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d097efb1ca5f85b18f735c9483e312b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72272688, jitterRate=0.07694697380065918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:33,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d097efb1ca5f85b18f735c9483e312b5: 2023-02-18 15:01:33,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5., pid=23, masterSystemTime=1676732493803 2023-02-18 15:01:33,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:33,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:33,886 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=60fcf24038136da91c1222b466e62c4f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:33,887 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676732493886"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732493886"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732493886"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732493886"}]},"ts":"1676732493886"} 2023-02-18 15:01:33,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:33,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:33,888 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d097efb1ca5f85b18f735c9483e312b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:33,888 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732493888"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732493888"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732493888"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732493888"}]},"ts":"1676732493888"} 2023-02-18 15:01:33,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=11 2023-02-18 15:01:33,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=11, state=SUCCESS; OpenRegionProcedure 60fcf24038136da91c1222b466e62c4f, server=jenkins-hbase4.apache.org,36479,1676732491663 in 232 msec 2023-02-18 15:01:33,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=16 2023-02-18 15:01:33,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=16, state=SUCCESS; OpenRegionProcedure d097efb1ca5f85b18f735c9483e312b5, server=jenkins-hbase4.apache.org,38837,1676732491639 in 236 msec 2023-02-18 15:01:33,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=60fcf24038136da91c1222b466e62c4f, ASSIGN in 400 msec 2023-02-18 15:01:33,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-18 15:01:33,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d097efb1ca5f85b18f735c9483e312b5, ASSIGN in 401 msec 2023-02-18 15:01:33,893 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:33,893 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732493893"}]},"ts":"1676732493893"} 2023-02-18 15:01:33,894 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-18 15:01:33,897 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:33,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 889 msec 2023-02-18 15:01:34,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:34,120 INFO [Listener at localhost/41495] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-18 15:01:34,120 DEBUG [Listener at localhost/41495] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-18 15:01:34,120 INFO [Listener at localhost/41495] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:34,123 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-18 15:01:34,124 INFO [Listener at localhost/41495] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:34,124 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-18 15:01:34,124 INFO [Listener at localhost/41495] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 15:01:34,154 DEBUG [hconnection-0x15a434f-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:34,163 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47086, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:34,169 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36479] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:34,179 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38837] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:34,256 INFO [Listener at localhost/41495] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 15:01:34,257 INFO [Listener at localhost/41495] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 15:01:34,258 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-18 15:01:34,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676732494258 (current time:1676732494258). 2023-02-18 15:01:34,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 15:01:34,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] zookeeper.ReadOnlyZKClient(139): Connect 0x49f53780 to 127.0.0.1:61834 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:34,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f916ae2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:34,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:34,274 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38062, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:34,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49f53780 to 127.0.0.1:61834 2023-02-18 15:01:34,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:34,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 15:01:34,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-18 15:01:34,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-18 15:01:34,279 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-18 15:01:34,280 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676733094280 2023-02-18 15:01:34,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-18 15:01:34,284 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,285 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-18 15:01:34,285 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:34,286 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 15:01:34,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-18 15:01:34,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 7 msec 2023-02-18 15:01:34,287 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-18 15:01:34,287 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676733094287 2023-02-18 15:01:34,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,310 INFO [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-18 15:01:34,310 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:34,311 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-18 15:01:34,311 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-18 15:01:34,312 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,312 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,313 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,313 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:34,313 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:34,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:34,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,314 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,314 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,315 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,315 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:34,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-18 15:01:34,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,316 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-18 15:01:34,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-18 15:01:34,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,316 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-18 15:01:34,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,317 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-18 15:01:34,317 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:34,320 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 15:01:34,320 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 15:01:34,320 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-18 15:01:34,320 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:34,320 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36479,1676732491663' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 15:01:34,320 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 15:01:34,320 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 15:01:34,320 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38837,1676732491639' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 15:01:34,322 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,322 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:34,323 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,322 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,323 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,323 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:34,323 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,323 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:34,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36479,1676732491663' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 15:01:34,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27d41fc2[Count = 1] remaining members to acquire global barrier 2023-02-18 15:01:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:34,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38837,1676732491639' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 15:01:34,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27d41fc2[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:34,327 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-18 15:01:34,327 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,329 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,329 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,329 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 15:01:34,329 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 15:01:34,329 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:34,329 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. started... 2023-02-18 15:01:34,329 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:34,330 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:34,331 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:34,331 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. started... 2023-02-18 15:01:34,331 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 15:01:34,331 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 15:01:34,331 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 15:01:34,332 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 15:01:34,332 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f38c2b0d8bdfee48c79d8e2e48e87f70 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:34,331 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5d55cd0811e64abcd9e6fa58191b0fd4 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 15:01:34,331 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:34,331 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. started... 2023-02-18 15:01:34,333 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 60fcf24038136da91c1222b466e62c4f: 2023-02-18 15:01:34,333 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,331 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:34,331 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. started... 2023-02-18 15:01:34,334 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. started... 2023-02-18 15:01:34,334 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:34,332 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. started... 2023-02-18 15:01:34,335 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:34,336 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2ac5ba9e0adcd5edd0f46077da3de996 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:34,335 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f00f071a5b247f9c69489550eafadf7e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:34,336 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d3e65d483df1348874accc9495c2f30c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 15:01:34,336 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:34,337 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,338 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,338 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:34,380 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. completed. 2023-02-18 15:01:34,380 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:34,380 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:34,380 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 15:01:34,380 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. started... 2023-02-18 15:01:34,380 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/.tmp/f1/0c5ecd05d1d94fde945396d135fd16c6 2023-02-18 15:01:34,381 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/.tmp/f1/8a484a1ea6954f0380524535edf43218 2023-02-18 15:01:34,385 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3dc6e1c27e3ffcaf5419a0eac034619f: 2023-02-18 15:01:34,385 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,385 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:34,385 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:34,385 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 15:01:34,386 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:34,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 15:01:34,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:34,387 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 15:01:34,396 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/.tmp/f1/86676fab505c48218e18a488dc9e4353 2023-02-18 15:01:34,411 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/.tmp/f1/d74892400b524ded920fbe226c23b5e1 2023-02-18 15:01:34,411 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/.tmp/f1/54fff0caacbb409a97ec5965622a08f5 2023-02-18 15:01:34,432 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. completed. 2023-02-18 15:01:34,432 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:34,432 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/.tmp/f2/b1ada03bf8904371a96dbe1dfc0296d2 2023-02-18 15:01:34,432 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 15:01:34,432 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:34,432 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. started... 2023-02-18 15:01:34,437 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] regionserver.HRegion(2744): Flushing cf5bdeb8bb5eb132408d6e2daa4817d4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:34,443 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/.tmp/f1/8a484a1ea6954f0380524535edf43218 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1/8a484a1ea6954f0380524535edf43218 2023-02-18 15:01:34,445 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/.tmp/f2/76af3a66187140f49ec305abcdb306ea 2023-02-18 15:01:34,449 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1/8a484a1ea6954f0380524535edf43218, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:34,450 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/.tmp/f2/b1ada03bf8904371a96dbe1dfc0296d2 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2/b1ada03bf8904371a96dbe1dfc0296d2 2023-02-18 15:01:34,455 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2/b1ada03bf8904371a96dbe1dfc0296d2, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:34,458 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 5d55cd0811e64abcd9e6fa58191b0fd4 in 127ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:34,458 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-18 15:01:34,458 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5d55cd0811e64abcd9e6fa58191b0fd4: 2023-02-18 15:01:34,459 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,460 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/.tmp/f2/ffdc192703d24678be0ab782b89715d1 2023-02-18 15:01:34,464 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/.tmp/f2/0202d1b0971f46bfa91a07b89deb02a0 2023-02-18 15:01:34,465 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/.tmp/f1/0c5ecd05d1d94fde945396d135fd16c6 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1/0c5ecd05d1d94fde945396d135fd16c6 2023-02-18 15:01:34,468 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/.tmp/f1/86676fab505c48218e18a488dc9e4353 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1/86676fab505c48218e18a488dc9e4353 2023-02-18 15:01:34,469 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:34,470 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1/8a484a1ea6954f0380524535edf43218] hfiles 2023-02-18 15:01:34,470 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1/8a484a1ea6954f0380524535edf43218 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,470 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2/b1ada03bf8904371a96dbe1dfc0296d2] hfiles 2023-02-18 15:01:34,470 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2/b1ada03bf8904371a96dbe1dfc0296d2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,470 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/.tmp/f2/dfa0fa380969454e81e37b3c2c325dd3 2023-02-18 15:01:34,471 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1/0c5ecd05d1d94fde945396d135fd16c6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,473 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/.tmp/f1/54fff0caacbb409a97ec5965622a08f5 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1/54fff0caacbb409a97ec5965622a08f5 2023-02-18 15:01:34,474 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/.tmp/f2/76af3a66187140f49ec305abcdb306ea as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2/76af3a66187140f49ec305abcdb306ea 2023-02-18 15:01:34,475 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/.tmp/f1/d74892400b524ded920fbe226c23b5e1 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1/d74892400b524ded920fbe226c23b5e1 2023-02-18 15:01:34,479 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2/76af3a66187140f49ec305abcdb306ea, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,480 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1/86676fab505c48218e18a488dc9e4353, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,480 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f38c2b0d8bdfee48c79d8e2e48e87f70 in 148ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:34,482 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f38c2b0d8bdfee48c79d8e2e48e87f70: 2023-02-18 15:01:34,482 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,482 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:34,482 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1/54fff0caacbb409a97ec5965622a08f5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,482 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1/d74892400b524ded920fbe226c23b5e1, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:34,482 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/.tmp/f2/0202d1b0971f46bfa91a07b89deb02a0 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2/0202d1b0971f46bfa91a07b89deb02a0 2023-02-18 15:01:34,483 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/.tmp/f2/ffdc192703d24678be0ab782b89715d1 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2/ffdc192703d24678be0ab782b89715d1 2023-02-18 15:01:34,483 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/.tmp/f2/dfa0fa380969454e81e37b3c2c325dd3 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2/dfa0fa380969454e81e37b3c2c325dd3 2023-02-18 15:01:34,484 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1/0c5ecd05d1d94fde945396d135fd16c6] hfiles 2023-02-18 15:01:34,484 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1/0c5ecd05d1d94fde945396d135fd16c6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,484 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2/76af3a66187140f49ec305abcdb306ea] hfiles 2023-02-18 15:01:34,484 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2/76af3a66187140f49ec305abcdb306ea for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,495 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2/dfa0fa380969454e81e37b3c2c325dd3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 15:01:34,496 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d3e65d483df1348874accc9495c2f30c in 160ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:34,496 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d3e65d483df1348874accc9495c2f30c: 2023-02-18 15:01:34,496 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,496 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:34,496 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1/d74892400b524ded920fbe226c23b5e1] hfiles 2023-02-18 15:01:34,496 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1/d74892400b524ded920fbe226c23b5e1 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,496 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2/dfa0fa380969454e81e37b3c2c325dd3] hfiles 2023-02-18 15:01:34,496 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2/dfa0fa380969454e81e37b3c2c325dd3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,500 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. completed. 2023-02-18 15:01:34,500 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:34,500 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:34,500 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. started... 2023-02-18 15:01:34,500 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 15:01:34,501 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d097efb1ca5f85b18f735c9483e312b5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:34,504 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2/ffdc192703d24678be0ab782b89715d1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,504 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2/0202d1b0971f46bfa91a07b89deb02a0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,505 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f00f071a5b247f9c69489550eafadf7e in 170ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:34,505 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f00f071a5b247f9c69489550eafadf7e: 2023-02-18 15:01:34,505 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,505 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:34,505 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1/86676fab505c48218e18a488dc9e4353] hfiles 2023-02-18 15:01:34,505 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1/86676fab505c48218e18a488dc9e4353 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,505 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2/0202d1b0971f46bfa91a07b89deb02a0] hfiles 2023-02-18 15:01:34,505 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2/0202d1b0971f46bfa91a07b89deb02a0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,506 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2ac5ba9e0adcd5edd0f46077da3de996 in 171ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:34,506 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2ac5ba9e0adcd5edd0f46077da3de996: 2023-02-18 15:01:34,506 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,506 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:34,506 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1/54fff0caacbb409a97ec5965622a08f5] hfiles 2023-02-18 15:01:34,506 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1/54fff0caacbb409a97ec5965622a08f5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,506 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2/ffdc192703d24678be0ab782b89715d1] hfiles 2023-02-18 15:01:34,506 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2/ffdc192703d24678be0ab782b89715d1 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,528 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. completed. 2023-02-18 15:01:34,528 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:34,528 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 15:01:34,528 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. completed. 2023-02-18 15:01:34,528 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:34,528 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:34,528 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 15:01:34,528 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. started... 2023-02-18 15:01:34,530 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HRegion(2744): Flushing eb11a992c540b181cd13c8a05f341a03 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 15:01:34,544 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. completed. 2023-02-18 15:01:34,544 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:34,544 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 15:01:34,544 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. completed. 2023-02-18 15:01:34,544 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:34,544 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/.tmp/f1/5de26e413ae84c4989fd37d5c32a1767 2023-02-18 15:01:34,544 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 15:01:34,547 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/.tmp/f1/5ee55c6a20cd464ca1b5d79ebea03a5a 2023-02-18 15:01:34,572 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/.tmp/f2/501655bd03634d9d9192cc3af3efefce 2023-02-18 15:01:34,572 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/.tmp/f2/f69c7a42ffc743e3aabb0cbe157888d5 2023-02-18 15:01:34,577 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/.tmp/f1/5ee55c6a20cd464ca1b5d79ebea03a5a as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1/5ee55c6a20cd464ca1b5d79ebea03a5a 2023-02-18 15:01:34,577 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/.tmp/f1/5de26e413ae84c4989fd37d5c32a1767 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1/5de26e413ae84c4989fd37d5c32a1767 2023-02-18 15:01:34,581 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1/5ee55c6a20cd464ca1b5d79ebea03a5a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,582 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1/5de26e413ae84c4989fd37d5c32a1767, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,584 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/.tmp/f2/501655bd03634d9d9192cc3af3efefce as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2/501655bd03634d9d9192cc3af3efefce 2023-02-18 15:01:34,584 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/.tmp/f2/f69c7a42ffc743e3aabb0cbe157888d5 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2/f69c7a42ffc743e3aabb0cbe157888d5 2023-02-18 15:01:34,588 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:34,589 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2/501655bd03634d9d9192cc3af3efefce, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 15:01:34,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:34,589 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-18 15:01:34,589 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for eb11a992c540b181cd13c8a05f341a03 in 59ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:34,590 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for eb11a992c540b181cd13c8a05f341a03: 2023-02-18 15:01:34,590 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,590 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:34,590 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1/5ee55c6a20cd464ca1b5d79ebea03a5a] hfiles 2023-02-18 15:01:34,590 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1/5ee55c6a20cd464ca1b5d79ebea03a5a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,590 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2/501655bd03634d9d9192cc3af3efefce] hfiles 2023-02-18 15:01:34,590 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2/501655bd03634d9d9192cc3af3efefce for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,591 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2/f69c7a42ffc743e3aabb0cbe157888d5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,592 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d097efb1ca5f85b18f735c9483e312b5 in 91ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:34,592 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d097efb1ca5f85b18f735c9483e312b5: 2023-02-18 15:01:34,593 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,593 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:34,593 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1/5de26e413ae84c4989fd37d5c32a1767] hfiles 2023-02-18 15:01:34,593 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1/5de26e413ae84c4989fd37d5c32a1767 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,593 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2/f69c7a42ffc743e3aabb0cbe157888d5] hfiles 2023-02-18 15:01:34,593 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2/f69c7a42ffc743e3aabb0cbe157888d5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,597 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. completed. 2023-02-18 15:01:34,597 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:34,597 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 15:01:34,599 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. completed. 2023-02-18 15:01:34,599 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:34,599 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 15:01:34,599 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 15:01:34,599 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,599 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 15:01:34,599 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38837,1676732491639' in zk 2023-02-18 15:01:34,601 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,601 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 15:01:34,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,601 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:34,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:34,601 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 15:01:34,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38837,1676732491639': 2023-02-18 15:01:34,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38837,1676732491639' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 15:01:34,889 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:34,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 15:01:34,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:34,891 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-18 15:01:34,893 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/.tmp/f1/8629b2c5258747e790b6b5155c6901e1 2023-02-18 15:01:34,909 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/.tmp/f2/d9144bbb42ea4f8ab23168ae262e257c 2023-02-18 15:01:34,913 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/.tmp/f1/8629b2c5258747e790b6b5155c6901e1 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1/8629b2c5258747e790b6b5155c6901e1 2023-02-18 15:01:34,917 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1/8629b2c5258747e790b6b5155c6901e1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,917 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/.tmp/f2/d9144bbb42ea4f8ab23168ae262e257c as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2/d9144bbb42ea4f8ab23168ae262e257c 2023-02-18 15:01:34,921 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2/d9144bbb42ea4f8ab23168ae262e257c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 15:01:34,921 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cf5bdeb8bb5eb132408d6e2daa4817d4 in 484ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:34,922 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for cf5bdeb8bb5eb132408d6e2daa4817d4: 2023-02-18 15:01:34,922 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,922 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:34,922 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1/8629b2c5258747e790b6b5155c6901e1] hfiles 2023-02-18 15:01:34,922 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1/8629b2c5258747e790b6b5155c6901e1 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,922 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2/d9144bbb42ea4f8ab23168ae262e257c] hfiles 2023-02-18 15:01:34,922 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2/d9144bbb42ea4f8ab23168ae262e257c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,928 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. completed. 2023-02-18 15:01:34,928 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:34,928 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 15:01:34,929 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 15:01:34,929 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,929 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 15:01:34,929 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36479,1676732491663' in zk 2023-02-18 15:01:34,930 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,930 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 15:01:34,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:34,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:34,930 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:34,930 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 15:01:34,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:34,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:34,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:34,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36479,1676732491663': 2023-02-18 15:01:34,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36479,1676732491663' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 15:01:34,933 INFO [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-18 15:01:34,933 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:34,933 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:34,933 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,933 INFO [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 15:01:34,936 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,936 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,936 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:34,936 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,936 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:34,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:34,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:34,936 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,937 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,938 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:34,938 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,943 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,943 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,943 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:34,943 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:34,943 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:34,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:34,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,943 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:34,943 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:34,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:34,943 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:34,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:34,943 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:34,943 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:34,944 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,944 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:34,944 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,944 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:34,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:34,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,022 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-18 15:01:35,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,023 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676732494284Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676732494943 (+659 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676732494943Writing data manifest for testWithMockedMapReduceMultiRegion at 1676732494954 (+11 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676732494969 (+15 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676732495022 (+53 ms) 2023-02-18 15:01:35,025 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-18 15:01:35,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 740 msec 2023-02-18 15:01:35,391 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:35,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 15:01:35,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 15:01:35,393 INFO [Listener at localhost/41495] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 15:01:35,397 INFO [Listener at localhost/41495] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 15:01:35,404 INFO [Listener at localhost/41495] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 15:01:35,427 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36479] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:35,434 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38837] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:35,495 INFO [Listener at localhost/41495] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 15:01:35,501 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 15:01:35,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,504 INFO [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-18 15:01:35,504 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:35,505 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-18 15:01:35,505 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-18 15:01:35,505 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,505 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,562 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:35,562 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:35,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:35,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:35,562 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:35,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:35,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:35,562 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:35,562 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:35,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,563 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:35,563 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:35,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,563 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,563 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,563 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 15:01:35,564 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-18 15:01:35,564 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-18 15:01:35,564 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:35,564 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:35,565 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 15:01:35,565 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. started... 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. started... 2023-02-18 15:01:35,566 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5d55cd0811e64abcd9e6fa58191b0fd4 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. started... 2023-02-18 15:01:35,566 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 15:01:35,566 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f00f071a5b247f9c69489550eafadf7e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. started... 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. started... 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 60fcf24038136da91c1222b466e62c4f: 2023-02-18 15:01:35,566 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f38c2b0d8bdfee48c79d8e2e48e87f70 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:35,566 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d3e65d483df1348874accc9495c2f30c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 15:01:35,566 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 15:01:35,567 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:35,567 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:35,567 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. started... 2023-02-18 15:01:35,566 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:35,566 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 15:01:35,567 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. started... 2023-02-18 15:01:35,567 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3dc6e1c27e3ffcaf5419a0eac034619f: 2023-02-18 15:01:35,569 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:35,569 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2ac5ba9e0adcd5edd0f46077da3de996 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:35,568 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 15:01:35,569 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:35,569 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 15:01:35,569 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. started... 2023-02-18 15:01:35,569 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cf5bdeb8bb5eb132408d6e2daa4817d4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:35,595 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/.tmp/f1/1386db8701424419b5a5f3299705e684 2023-02-18 15:01:35,596 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/.tmp/f1/dd738b4ca0d64095946aa0c3a060c183 2023-02-18 15:01:35,597 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/.tmp/f1/0062bbe168274bfa914581a593c2ff16 2023-02-18 15:01:35,600 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/.tmp/f1/eb2333cd2c6d43bfa2fdf78977a76182 2023-02-18 15:01:35,612 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/.tmp/f1/a538b7380865426b82299bef0391175d 2023-02-18 15:01:35,628 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/.tmp/f2/38fd7e01bf8546b68dec9384dd0c732a 2023-02-18 15:01:35,633 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/.tmp/f1/1386db8701424419b5a5f3299705e684 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1/1386db8701424419b5a5f3299705e684 2023-02-18 15:01:35,633 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/.tmp/f2/01ef97c9f7be4121b15e42182701288c 2023-02-18 15:01:35,638 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1/1386db8701424419b5a5f3299705e684, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:35,638 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/.tmp/f1/0062bbe168274bfa914581a593c2ff16 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1/0062bbe168274bfa914581a593c2ff16 2023-02-18 15:01:35,639 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/.tmp/f2/edce0a73978e4a1aaac00c482891060a 2023-02-18 15:01:35,639 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/.tmp/f2/38fd7e01bf8546b68dec9384dd0c732a as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2/38fd7e01bf8546b68dec9384dd0c732a 2023-02-18 15:01:35,643 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1/0062bbe168274bfa914581a593c2ff16, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:35,644 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2/38fd7e01bf8546b68dec9384dd0c732a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:35,644 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/.tmp/f2/01ef97c9f7be4121b15e42182701288c as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2/01ef97c9f7be4121b15e42182701288c 2023-02-18 15:01:35,644 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/.tmp/f1/eb2333cd2c6d43bfa2fdf78977a76182 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1/eb2333cd2c6d43bfa2fdf78977a76182 2023-02-18 15:01:35,645 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f00f071a5b247f9c69489550eafadf7e in 79ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:35,645 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f00f071a5b247f9c69489550eafadf7e: 2023-02-18 15:01:35,645 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:35,645 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:35,645 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. started... 2023-02-18 15:01:35,645 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 15:01:35,646 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d097efb1ca5f85b18f735c9483e312b5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:35,652 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1/eb2333cd2c6d43bfa2fdf78977a76182, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:35,652 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2/01ef97c9f7be4121b15e42182701288c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:35,653 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/.tmp/f2/edce0a73978e4a1aaac00c482891060a as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2/edce0a73978e4a1aaac00c482891060a 2023-02-18 15:01:35,653 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2ac5ba9e0adcd5edd0f46077da3de996 in 84ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:35,653 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2ac5ba9e0adcd5edd0f46077da3de996: 2023-02-18 15:01:35,653 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:35,653 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 15:01:35,658 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2/edce0a73978e4a1aaac00c482891060a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:35,658 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 5d55cd0811e64abcd9e6fa58191b0fd4 in 92ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:35,658 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5d55cd0811e64abcd9e6fa58191b0fd4: 2023-02-18 15:01:35,658 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:35,658 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:35,658 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 15:01:35,658 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. started... 2023-02-18 15:01:35,659 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eb11a992c540b181cd13c8a05f341a03 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 15:01:35,664 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/.tmp/f1/6c1e76f6f8dc4bb6a422672c0b94edbd 2023-02-18 15:01:35,670 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/.tmp/f1/d4e135dcfe594eeb8f9a763c521d9a6b 2023-02-18 15:01:35,679 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/.tmp/f2/abd87e2424e04b4382c50b9e69c1f1be 2023-02-18 15:01:35,683 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/.tmp/f2/ba5034045204450b987b95d47e0ac4f8 2023-02-18 15:01:35,684 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/.tmp/f1/6c1e76f6f8dc4bb6a422672c0b94edbd as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1/6c1e76f6f8dc4bb6a422672c0b94edbd 2023-02-18 15:01:35,687 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1/6c1e76f6f8dc4bb6a422672c0b94edbd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:35,688 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/.tmp/f1/d4e135dcfe594eeb8f9a763c521d9a6b as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1/d4e135dcfe594eeb8f9a763c521d9a6b 2023-02-18 15:01:35,688 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/.tmp/f2/abd87e2424e04b4382c50b9e69c1f1be as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2/abd87e2424e04b4382c50b9e69c1f1be 2023-02-18 15:01:35,693 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2/abd87e2424e04b4382c50b9e69c1f1be, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:35,693 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1/d4e135dcfe594eeb8f9a763c521d9a6b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:35,694 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d097efb1ca5f85b18f735c9483e312b5 in 48ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:35,694 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d097efb1ca5f85b18f735c9483e312b5: 2023-02-18 15:01:35,694 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/.tmp/f2/ba5034045204450b987b95d47e0ac4f8 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2/ba5034045204450b987b95d47e0ac4f8 2023-02-18 15:01:35,694 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:35,694 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 15:01:35,698 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2/ba5034045204450b987b95d47e0ac4f8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:35,698 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for eb11a992c540b181cd13c8a05f341a03 in 39ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:35,699 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eb11a992c540b181cd13c8a05f341a03: 2023-02-18 15:01:35,699 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:35,699 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 15:01:36,013 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/.tmp/f1/a967d3a7cb39468893ba6dbd545e0e9a 2023-02-18 15:01:36,023 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/.tmp/f2/f654fab3d41345e899995517a35ac9e4 2023-02-18 15:01:36,025 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/.tmp/f2/88ec45b833cf4a1e9eb7a1bf5450823f 2023-02-18 15:01:36,027 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/.tmp/f1/a967d3a7cb39468893ba6dbd545e0e9a as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1/a967d3a7cb39468893ba6dbd545e0e9a 2023-02-18 15:01:36,029 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/.tmp/f1/dd738b4ca0d64095946aa0c3a060c183 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1/dd738b4ca0d64095946aa0c3a060c183 2023-02-18 15:01:36,031 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1/a967d3a7cb39468893ba6dbd545e0e9a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:36,032 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/.tmp/f2/f654fab3d41345e899995517a35ac9e4 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2/f654fab3d41345e899995517a35ac9e4 2023-02-18 15:01:36,033 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1/dd738b4ca0d64095946aa0c3a060c183, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:36,034 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/.tmp/f2/88ec45b833cf4a1e9eb7a1bf5450823f as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2/88ec45b833cf4a1e9eb7a1bf5450823f 2023-02-18 15:01:36,038 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2/f654fab3d41345e899995517a35ac9e4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:36,038 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cf5bdeb8bb5eb132408d6e2daa4817d4 in 469ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:36,039 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cf5bdeb8bb5eb132408d6e2daa4817d4: 2023-02-18 15:01:36,039 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:36,039 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 15:01:36,039 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2/88ec45b833cf4a1e9eb7a1bf5450823f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 15:01:36,040 INFO [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d3e65d483df1348874accc9495c2f30c in 474ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:36,040 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d3e65d483df1348874accc9495c2f30c: 2023-02-18 15:01:36,040 DEBUG [rs(jenkins-hbase4.apache.org,38837,1676732491639)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:36,040 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 15:01:36,040 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 15:01:36,040 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,040 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 15:01:36,040 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38837,1676732491639' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 15:01:36,048 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/.tmp/f2/07c3e9e482124a21b6b984d9cd8975bb 2023-02-18 15:01:36,054 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/.tmp/f1/a538b7380865426b82299bef0391175d as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1/a538b7380865426b82299bef0391175d 2023-02-18 15:01:36,060 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1/a538b7380865426b82299bef0391175d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:36,061 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/.tmp/f2/07c3e9e482124a21b6b984d9cd8975bb as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2/07c3e9e482124a21b6b984d9cd8975bb 2023-02-18 15:01:36,067 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2/07c3e9e482124a21b6b984d9cd8975bb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 15:01:36,068 INFO [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f38c2b0d8bdfee48c79d8e2e48e87f70 in 502ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:36,068 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f38c2b0d8bdfee48c79d8e2e48e87f70: 2023-02-18 15:01:36,068 DEBUG [rs(jenkins-hbase4.apache.org,36479,1676732491663)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:36,068 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 15:01:36,068 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 15:01:36,069 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,069 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 15:01:36,069 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36479,1676732491663' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 15:01:36,139 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,139 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:36,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:36,216 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:36,216 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,216 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:36,216 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,216 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,216 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:36,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38837,1676732491639' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 15:01:36,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23eb9fe0[Count = 1] remaining members to acquire global barrier 2023-02-18 15:01:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:36,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36479,1676732491663' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 15:01:36,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23eb9fe0[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:36,220 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-18 15:01:36,220 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,293 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,293 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,293 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,293 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 15:01:36,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,293 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 15:01:36,293 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 15:01:36,293 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 15:01:36,293 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36479,1676732491663' in zk 2023-02-18 15:01:36,293 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38837,1676732491639' in zk 2023-02-18 15:01:36,293 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,293 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:36,339 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 15:01:36,339 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 15:01:36,339 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,339 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:36,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:36,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:36,339 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:36,339 DEBUG [member: 'jenkins-hbase4.apache.org,36479,1676732491663' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 15:01:36,339 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,340 DEBUG [member: 'jenkins-hbase4.apache.org,38837,1676732491639' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 15:01:36,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:36,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:36,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:36,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38837,1676732491639': 2023-02-18 15:01:36,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38837,1676732491639' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 15:01:36,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:36,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:36,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:36,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:36,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:36,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36479,1676732491663': 2023-02-18 15:01:36,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36479,1676732491663' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 15:01:36,345 INFO [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-18 15:01:36,345 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:36,345 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:36,345 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,345 INFO [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 15:01:36,393 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,393 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:36,393 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,393 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,393 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:36,394 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,394 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:36,396 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,396 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,447 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,447 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:36,447 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:36,447 DEBUG [(jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:36,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:36,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:36,447 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:36,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-18 15:01:36,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 15:01:36,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:36,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:36,447 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:36,447 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,447 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,448 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,448 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:36,448 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:36,448 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:36,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:36,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:36,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:36,448 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:36,448 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,448 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 15:01:36,448 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,548 DEBUG [Listener at localhost/41495] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 15:01:36,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 15:01:36,554 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676732494258 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:36,555 DEBUG [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,555 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(239): region to add: 5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:36,555 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(239): region to add: f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:36,555 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(239): region to add: 60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:36,555 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(239): region to add: f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:36,555 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(239): region to add: 2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(239): region to add: 3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(239): region to add: d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(239): region to add: d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(239): region to add: eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(239): region to add: cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(585): clone region=5d55cd0811e64abcd9e6fa58191b0fd4 as 5d55cd0811e64abcd9e6fa58191b0fd4 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(585): clone region=f38c2b0d8bdfee48c79d8e2e48e87f70 as f38c2b0d8bdfee48c79d8e2e48e87f70 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(585): clone region=60fcf24038136da91c1222b466e62c4f as 60fcf24038136da91c1222b466e62c4f in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(585): clone region=f00f071a5b247f9c69489550eafadf7e as f00f071a5b247f9c69489550eafadf7e in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(585): clone region=2ac5ba9e0adcd5edd0f46077da3de996 as 2ac5ba9e0adcd5edd0f46077da3de996 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(585): clone region=3dc6e1c27e3ffcaf5419a0eac034619f as 3dc6e1c27e3ffcaf5419a0eac034619f in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,556 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(585): clone region=d3e65d483df1348874accc9495c2f30c as d3e65d483df1348874accc9495c2f30c in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,557 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(585): clone region=d097efb1ca5f85b18f735c9483e312b5 as d097efb1ca5f85b18f735c9483e312b5 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,557 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(585): clone region=eb11a992c540b181cd13c8a05f341a03 as eb11a992c540b181cd13c8a05f341a03 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,557 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(585): clone region=cf5bdeb8bb5eb132408d6e2daa4817d4 as cf5bdeb8bb5eb132408d6e2daa4817d4 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,557 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5d55cd0811e64abcd9e6fa58191b0fd4, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,558 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 3dc6e1c27e3ffcaf5419a0eac034619f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,558 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 2ac5ba9e0adcd5edd0f46077da3de996, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,558 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => f00f071a5b247f9c69489550eafadf7e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,559 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => f38c2b0d8bdfee48c79d8e2e48e87f70, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,559 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 60fcf24038136da91c1222b466e62c4f, NAME => 'testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,559 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => d3e65d483df1348874accc9495c2f30c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,559 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => d097efb1ca5f85b18f735c9483e312b5, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,574 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:36,574 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0c5ecd05d1d94fde945396d135fd16c6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,576 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:36,576 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 3dc6e1c27e3ffcaf5419a0eac034619f, disabling compactions & flushes 2023-02-18 15:01:36,576 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:36,576 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:36,576 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. after waiting 0 ms 2023-02-18 15:01:36,576 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:36,576 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:36,576 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 3dc6e1c27e3ffcaf5419a0eac034619f: 2023-02-18 15:01:36,577 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 76af3a66187140f49ec305abcdb306ea from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,577 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => eb11a992c540b181cd13c8a05f341a03, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,580 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing f38c2b0d8bdfee48c79d8e2e48e87f70, disabling compactions & flushes 2023-02-18 15:01:36,581 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:36,581 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:36,581 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. after waiting 0 ms 2023-02-18 15:01:36,581 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:36,581 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:36,581 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for f38c2b0d8bdfee48c79d8e2e48e87f70: 2023-02-18 15:01:36,581 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => cf5bdeb8bb5eb132408d6e2daa4817d4, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,589 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:36,590 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 60fcf24038136da91c1222b466e62c4f, disabling compactions & flushes 2023-02-18 15:01:36,590 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:36,590 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:36,590 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. after waiting 0 ms 2023-02-18 15:01:36,590 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:36,590 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:36,590 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 60fcf24038136da91c1222b466e62c4f: 2023-02-18 15:01:36,591 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:36,591 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 54fff0caacbb409a97ec5965622a08f5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,592 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:36,592 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8a484a1ea6954f0380524535edf43218 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,593 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:36,593 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5de26e413ae84c4989fd37d5c32a1767 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,594 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:36,594 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d74892400b524ded920fbe226c23b5e1 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,596 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:36,596 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8629b2c5258747e790b6b5155c6901e1 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,603 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:36,603 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5ee55c6a20cd464ca1b5d79ebea03a5a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,608 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ffdc192703d24678be0ab782b89715d1 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,608 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:36,608 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f69c7a42ffc743e3aabb0cbe157888d5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,608 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 86676fab505c48218e18a488dc9e4353 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,608 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dfa0fa380969454e81e37b3c2c325dd3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,609 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d9144bbb42ea4f8ab23168ae262e257c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,609 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b1ada03bf8904371a96dbe1dfc0296d2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,611 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing d3e65d483df1348874accc9495c2f30c, disabling compactions & flushes 2023-02-18 15:01:36,611 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing d097efb1ca5f85b18f735c9483e312b5, disabling compactions & flushes 2023-02-18 15:01:36,611 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:36,611 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:36,611 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:36,611 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:36,611 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. after waiting 0 ms 2023-02-18 15:01:36,611 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. after waiting 0 ms 2023-02-18 15:01:36,611 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:36,611 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:36,612 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0202d1b0971f46bfa91a07b89deb02a0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,611 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing cf5bdeb8bb5eb132408d6e2daa4817d4, disabling compactions & flushes 2023-02-18 15:01:36,612 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:36,612 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 501655bd03634d9d9192cc3af3efefce from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for d097efb1ca5f85b18f735c9483e312b5: 2023-02-18 15:01:36,612 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for d3e65d483df1348874accc9495c2f30c: 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. after waiting 0 ms 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:36,612 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5d55cd0811e64abcd9e6fa58191b0fd4, disabling compactions & flushes 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for cf5bdeb8bb5eb132408d6e2daa4817d4: 2023-02-18 15:01:36,612 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. after waiting 0 ms 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:36,612 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:36,612 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5d55cd0811e64abcd9e6fa58191b0fd4: 2023-02-18 15:01:36,613 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 2ac5ba9e0adcd5edd0f46077da3de996, disabling compactions & flushes 2023-02-18 15:01:36,613 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:36,613 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:36,613 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. after waiting 0 ms 2023-02-18 15:01:36,613 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:36,613 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:36,613 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 2ac5ba9e0adcd5edd0f46077da3de996: 2023-02-18 15:01:36,616 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing eb11a992c540b181cd13c8a05f341a03, disabling compactions & flushes 2023-02-18 15:01:36,616 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:36,616 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:36,616 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. after waiting 0 ms 2023-02-18 15:01:36,616 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:36,616 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:36,616 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for eb11a992c540b181cd13c8a05f341a03: 2023-02-18 15:01:36,616 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing f00f071a5b247f9c69489550eafadf7e, disabling compactions & flushes 2023-02-18 15:01:36,616 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:36,616 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:36,616 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. after waiting 0 ms 2023-02-18 15:01:36,616 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:36,616 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:36,616 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for f00f071a5b247f9c69489550eafadf7e: 2023-02-18 15:01:36,617 INFO [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676732494258 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:36,617 DEBUG [Listener at localhost/41495] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,617 DEBUG [Listener at localhost/41495] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f 2023-02-18 15:01:36,617 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-data/ 2023-02-18 15:01:36,618 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |----default/ 2023-02-18 15:01:36,618 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-18 15:01:36,618 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |----------2ac5ba9e0adcd5edd0f46077da3de996/ 2023-02-18 15:01:36,619 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:36,619 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:36,619 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2ac5ba9e0adcd5edd0f46077da3de996-54fff0caacbb409a97ec5965622a08f5 2023-02-18 15:01:36,619 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:36,620 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2ac5ba9e0adcd5edd0f46077da3de996-ffdc192703d24678be0ab782b89715d1 2023-02-18 15:01:36,620 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |----------3dc6e1c27e3ffcaf5419a0eac034619f/ 2023-02-18 15:01:36,620 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:36,620 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |----------5d55cd0811e64abcd9e6fa58191b0fd4/ 2023-02-18 15:01:36,620 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:36,620 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:36,621 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5d55cd0811e64abcd9e6fa58191b0fd4-8a484a1ea6954f0380524535edf43218 2023-02-18 15:01:36,621 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:36,621 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5d55cd0811e64abcd9e6fa58191b0fd4-b1ada03bf8904371a96dbe1dfc0296d2 2023-02-18 15:01:36,621 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |----------60fcf24038136da91c1222b466e62c4f/ 2023-02-18 15:01:36,621 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:36,621 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |----------cf5bdeb8bb5eb132408d6e2daa4817d4/ 2023-02-18 15:01:36,622 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:36,622 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:36,622 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cf5bdeb8bb5eb132408d6e2daa4817d4-8629b2c5258747e790b6b5155c6901e1 2023-02-18 15:01:36,622 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:36,622 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cf5bdeb8bb5eb132408d6e2daa4817d4-d9144bbb42ea4f8ab23168ae262e257c 2023-02-18 15:01:36,622 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |----------d097efb1ca5f85b18f735c9483e312b5/ 2023-02-18 15:01:36,623 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:36,623 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:36,623 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d097efb1ca5f85b18f735c9483e312b5-5de26e413ae84c4989fd37d5c32a1767 2023-02-18 15:01:36,623 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:36,623 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d097efb1ca5f85b18f735c9483e312b5-f69c7a42ffc743e3aabb0cbe157888d5 2023-02-18 15:01:36,623 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |----------d3e65d483df1348874accc9495c2f30c/ 2023-02-18 15:01:36,623 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:36,624 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:36,624 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d3e65d483df1348874accc9495c2f30c-d74892400b524ded920fbe226c23b5e1 2023-02-18 15:01:36,624 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:36,624 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d3e65d483df1348874accc9495c2f30c-dfa0fa380969454e81e37b3c2c325dd3 2023-02-18 15:01:36,624 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |----------eb11a992c540b181cd13c8a05f341a03/ 2023-02-18 15:01:36,624 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:36,624 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:36,625 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=eb11a992c540b181cd13c8a05f341a03-5ee55c6a20cd464ca1b5d79ebea03a5a 2023-02-18 15:01:36,625 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:36,625 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=eb11a992c540b181cd13c8a05f341a03-501655bd03634d9d9192cc3af3efefce 2023-02-18 15:01:36,625 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |----------f00f071a5b247f9c69489550eafadf7e/ 2023-02-18 15:01:36,625 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:36,625 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:36,626 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f00f071a5b247f9c69489550eafadf7e-86676fab505c48218e18a488dc9e4353 2023-02-18 15:01:36,626 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:36,626 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f00f071a5b247f9c69489550eafadf7e-0202d1b0971f46bfa91a07b89deb02a0 2023-02-18 15:01:36,626 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |----------f38c2b0d8bdfee48c79d8e2e48e87f70/ 2023-02-18 15:01:36,626 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:36,626 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:36,627 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f38c2b0d8bdfee48c79d8e2e48e87f70-0c5ecd05d1d94fde945396d135fd16c6 2023-02-18 15:01:36,627 DEBUG [Listener at localhost/41495] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:36,627 DEBUG [Listener at localhost/41495] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f38c2b0d8bdfee48c79d8e2e48e87f70-76af3a66187140f49ec305abcdb306ea 2023-02-18 15:01:36,630 INFO [Listener at localhost/41495] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 15:01:37,283 DEBUG [Listener at localhost/41495] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:37,283 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:37,284 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:37,286 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:37,287 DEBUG [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1 2023-02-18 15:01:37,287 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ac5ba9e0adcd5edd0f46077da3de996 columnFamilyName f1 2023-02-18 15:01:37,291 DEBUG [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1/testWithMockedMapReduceMultiRegion=2ac5ba9e0adcd5edd0f46077da3de996-54fff0caacbb409a97ec5965622a08f5 2023-02-18 15:01:37,291 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] regionserver.HStore(310): Store=2ac5ba9e0adcd5edd0f46077da3de996/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,292 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:37,292 DEBUG [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2 2023-02-18 15:01:37,293 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ac5ba9e0adcd5edd0f46077da3de996 columnFamilyName f2 2023-02-18 15:01:37,298 DEBUG [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2/testWithMockedMapReduceMultiRegion=2ac5ba9e0adcd5edd0f46077da3de996-ffdc192703d24678be0ab782b89715d1 2023-02-18 15:01:37,299 INFO [StoreOpener-2ac5ba9e0adcd5edd0f46077da3de996-1] regionserver.HStore(310): Store=2ac5ba9e0adcd5edd0f46077da3de996/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,299 DEBUG [Listener at localhost/41495] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:37,299 INFO [Listener at localhost/41495] regionserver.HRegion(1071): Opened 2ac5ba9e0adcd5edd0f46077da3de996; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70219650, jitterRate=0.046354323625564575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:37,299 DEBUG [Listener at localhost/41495] regionserver.HRegion(964): Region open journal for 2ac5ba9e0adcd5edd0f46077da3de996: 2023-02-18 15:01:37,347 DEBUG [Listener at localhost/41495] regionserver.HRegion(1603): Closing 2ac5ba9e0adcd5edd0f46077da3de996, disabling compactions & flushes 2023-02-18 15:01:37,348 INFO [Listener at localhost/41495] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:37,348 DEBUG [Listener at localhost/41495] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:37,348 DEBUG [Listener at localhost/41495] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. after waiting 0 ms 2023-02-18 15:01:37,348 DEBUG [Listener at localhost/41495] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:37,349 INFO [Listener at localhost/41495] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:37,349 DEBUG [Listener at localhost/41495] regionserver.HRegion(1557): Region close journal for 2ac5ba9e0adcd5edd0f46077da3de996: 2023-02-18 15:01:37,350 DEBUG [Listener at localhost/41495] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:37,350 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:37,351 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:37,353 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:37,354 DEBUG [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/f1 2023-02-18 15:01:37,355 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3dc6e1c27e3ffcaf5419a0eac034619f columnFamilyName f1 2023-02-18 15:01:37,355 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] regionserver.HStore(310): Store=3dc6e1c27e3ffcaf5419a0eac034619f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,355 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:37,356 DEBUG [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/f2 2023-02-18 15:01:37,357 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3dc6e1c27e3ffcaf5419a0eac034619f columnFamilyName f2 2023-02-18 15:01:37,357 INFO [StoreOpener-3dc6e1c27e3ffcaf5419a0eac034619f-1] regionserver.HStore(310): Store=3dc6e1c27e3ffcaf5419a0eac034619f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,357 DEBUG [Listener at localhost/41495] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:37,357 INFO [Listener at localhost/41495] regionserver.HRegion(1071): Opened 3dc6e1c27e3ffcaf5419a0eac034619f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60920503, jitterRate=-0.09221376478672028}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:37,357 DEBUG [Listener at localhost/41495] regionserver.HRegion(964): Region open journal for 3dc6e1c27e3ffcaf5419a0eac034619f: 2023-02-18 15:01:37,358 DEBUG [Listener at localhost/41495] regionserver.HRegion(1603): Closing 3dc6e1c27e3ffcaf5419a0eac034619f, disabling compactions & flushes 2023-02-18 15:01:37,358 INFO [Listener at localhost/41495] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:37,358 DEBUG [Listener at localhost/41495] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:37,358 DEBUG [Listener at localhost/41495] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. after waiting 0 ms 2023-02-18 15:01:37,358 DEBUG [Listener at localhost/41495] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:37,358 INFO [Listener at localhost/41495] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:37,358 DEBUG [Listener at localhost/41495] regionserver.HRegion(1557): Region close journal for 3dc6e1c27e3ffcaf5419a0eac034619f: 2023-02-18 15:01:37,359 DEBUG [Listener at localhost/41495] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:37,359 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:37,360 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:37,362 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:37,363 DEBUG [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/f1 2023-02-18 15:01:37,363 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60fcf24038136da91c1222b466e62c4f columnFamilyName f1 2023-02-18 15:01:37,363 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] regionserver.HStore(310): Store=60fcf24038136da91c1222b466e62c4f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,363 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:37,364 DEBUG [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/f2 2023-02-18 15:01:37,364 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60fcf24038136da91c1222b466e62c4f columnFamilyName f2 2023-02-18 15:01:37,365 INFO [StoreOpener-60fcf24038136da91c1222b466e62c4f-1] regionserver.HStore(310): Store=60fcf24038136da91c1222b466e62c4f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,365 DEBUG [Listener at localhost/41495] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:37,365 INFO [Listener at localhost/41495] regionserver.HRegion(1071): Opened 60fcf24038136da91c1222b466e62c4f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67323881, jitterRate=0.0032040029764175415}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:37,365 DEBUG [Listener at localhost/41495] regionserver.HRegion(964): Region open journal for 60fcf24038136da91c1222b466e62c4f: 2023-02-18 15:01:37,365 DEBUG [Listener at localhost/41495] regionserver.HRegion(1603): Closing 60fcf24038136da91c1222b466e62c4f, disabling compactions & flushes 2023-02-18 15:01:37,365 INFO [Listener at localhost/41495] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:37,365 DEBUG [Listener at localhost/41495] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:37,366 DEBUG [Listener at localhost/41495] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. after waiting 0 ms 2023-02-18 15:01:37,366 DEBUG [Listener at localhost/41495] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:37,366 INFO [Listener at localhost/41495] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:37,366 DEBUG [Listener at localhost/41495] regionserver.HRegion(1557): Region close journal for 60fcf24038136da91c1222b466e62c4f: 2023-02-18 15:01:37,367 DEBUG [Listener at localhost/41495] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:37,367 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:37,368 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:37,369 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:37,370 DEBUG [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1 2023-02-18 15:01:37,370 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d097efb1ca5f85b18f735c9483e312b5 columnFamilyName f1 2023-02-18 15:01:37,375 DEBUG [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1/testWithMockedMapReduceMultiRegion=d097efb1ca5f85b18f735c9483e312b5-5de26e413ae84c4989fd37d5c32a1767 2023-02-18 15:01:37,375 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] regionserver.HStore(310): Store=d097efb1ca5f85b18f735c9483e312b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,375 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:37,376 DEBUG [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2 2023-02-18 15:01:37,376 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d097efb1ca5f85b18f735c9483e312b5 columnFamilyName f2 2023-02-18 15:01:37,380 DEBUG [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2/testWithMockedMapReduceMultiRegion=d097efb1ca5f85b18f735c9483e312b5-f69c7a42ffc743e3aabb0cbe157888d5 2023-02-18 15:01:37,380 INFO [StoreOpener-d097efb1ca5f85b18f735c9483e312b5-1] regionserver.HStore(310): Store=d097efb1ca5f85b18f735c9483e312b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,380 DEBUG [Listener at localhost/41495] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:37,380 INFO [Listener at localhost/41495] regionserver.HRegion(1071): Opened d097efb1ca5f85b18f735c9483e312b5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69565293, jitterRate=0.036603644490242004}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:37,380 DEBUG [Listener at localhost/41495] regionserver.HRegion(964): Region open journal for d097efb1ca5f85b18f735c9483e312b5: 2023-02-18 15:01:37,389 DEBUG [Listener at localhost/41495] regionserver.HRegion(1603): Closing d097efb1ca5f85b18f735c9483e312b5, disabling compactions & flushes 2023-02-18 15:01:37,389 INFO [Listener at localhost/41495] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:37,389 DEBUG [Listener at localhost/41495] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:37,389 DEBUG [Listener at localhost/41495] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. after waiting 0 ms 2023-02-18 15:01:37,389 DEBUG [Listener at localhost/41495] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:37,390 INFO [Listener at localhost/41495] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:37,390 DEBUG [Listener at localhost/41495] regionserver.HRegion(1557): Region close journal for d097efb1ca5f85b18f735c9483e312b5: 2023-02-18 15:01:37,391 DEBUG [Listener at localhost/41495] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:37,391 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:37,392 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:37,394 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:37,394 DEBUG [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1 2023-02-18 15:01:37,395 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d55cd0811e64abcd9e6fa58191b0fd4 columnFamilyName f1 2023-02-18 15:01:37,399 DEBUG [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1/testWithMockedMapReduceMultiRegion=5d55cd0811e64abcd9e6fa58191b0fd4-8a484a1ea6954f0380524535edf43218 2023-02-18 15:01:37,399 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] regionserver.HStore(310): Store=5d55cd0811e64abcd9e6fa58191b0fd4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,399 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:37,400 DEBUG [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2 2023-02-18 15:01:37,400 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d55cd0811e64abcd9e6fa58191b0fd4 columnFamilyName f2 2023-02-18 15:01:37,403 DEBUG [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2/testWithMockedMapReduceMultiRegion=5d55cd0811e64abcd9e6fa58191b0fd4-b1ada03bf8904371a96dbe1dfc0296d2 2023-02-18 15:01:37,403 INFO [StoreOpener-5d55cd0811e64abcd9e6fa58191b0fd4-1] regionserver.HStore(310): Store=5d55cd0811e64abcd9e6fa58191b0fd4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,403 DEBUG [Listener at localhost/41495] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:37,403 INFO [Listener at localhost/41495] regionserver.HRegion(1071): Opened 5d55cd0811e64abcd9e6fa58191b0fd4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58781952, jitterRate=-0.12408065795898438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:37,404 DEBUG [Listener at localhost/41495] regionserver.HRegion(964): Region open journal for 5d55cd0811e64abcd9e6fa58191b0fd4: 2023-02-18 15:01:37,413 DEBUG [Listener at localhost/41495] regionserver.HRegion(1603): Closing 5d55cd0811e64abcd9e6fa58191b0fd4, disabling compactions & flushes 2023-02-18 15:01:37,413 INFO [Listener at localhost/41495] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:37,413 DEBUG [Listener at localhost/41495] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:37,413 DEBUG [Listener at localhost/41495] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. after waiting 0 ms 2023-02-18 15:01:37,413 DEBUG [Listener at localhost/41495] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:37,414 INFO [Listener at localhost/41495] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:37,414 DEBUG [Listener at localhost/41495] regionserver.HRegion(1557): Region close journal for 5d55cd0811e64abcd9e6fa58191b0fd4: 2023-02-18 15:01:37,415 DEBUG [Listener at localhost/41495] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:37,415 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:37,416 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:37,419 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:37,419 DEBUG [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1 2023-02-18 15:01:37,420 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf5bdeb8bb5eb132408d6e2daa4817d4 columnFamilyName f1 2023-02-18 15:01:37,423 DEBUG [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1/testWithMockedMapReduceMultiRegion=cf5bdeb8bb5eb132408d6e2daa4817d4-8629b2c5258747e790b6b5155c6901e1 2023-02-18 15:01:37,423 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] regionserver.HStore(310): Store=cf5bdeb8bb5eb132408d6e2daa4817d4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,423 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:37,424 DEBUG [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2 2023-02-18 15:01:37,424 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf5bdeb8bb5eb132408d6e2daa4817d4 columnFamilyName f2 2023-02-18 15:01:37,427 DEBUG [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2/testWithMockedMapReduceMultiRegion=cf5bdeb8bb5eb132408d6e2daa4817d4-d9144bbb42ea4f8ab23168ae262e257c 2023-02-18 15:01:37,427 INFO [StoreOpener-cf5bdeb8bb5eb132408d6e2daa4817d4-1] regionserver.HStore(310): Store=cf5bdeb8bb5eb132408d6e2daa4817d4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,427 DEBUG [Listener at localhost/41495] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:37,427 INFO [Listener at localhost/41495] regionserver.HRegion(1071): Opened cf5bdeb8bb5eb132408d6e2daa4817d4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64131225, jitterRate=-0.04437027871608734}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:37,427 DEBUG [Listener at localhost/41495] regionserver.HRegion(964): Region open journal for cf5bdeb8bb5eb132408d6e2daa4817d4: 2023-02-18 15:01:37,435 DEBUG [Listener at localhost/41495] regionserver.HRegion(1603): Closing cf5bdeb8bb5eb132408d6e2daa4817d4, disabling compactions & flushes 2023-02-18 15:01:37,436 INFO [Listener at localhost/41495] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:37,436 DEBUG [Listener at localhost/41495] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:37,436 DEBUG [Listener at localhost/41495] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. after waiting 0 ms 2023-02-18 15:01:37,436 DEBUG [Listener at localhost/41495] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:37,436 INFO [Listener at localhost/41495] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:37,436 DEBUG [Listener at localhost/41495] regionserver.HRegion(1557): Region close journal for cf5bdeb8bb5eb132408d6e2daa4817d4: 2023-02-18 15:01:37,437 DEBUG [Listener at localhost/41495] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:37,437 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:37,438 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:37,441 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:37,442 DEBUG [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1 2023-02-18 15:01:37,443 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb11a992c540b181cd13c8a05f341a03 columnFamilyName f1 2023-02-18 15:01:37,446 DEBUG [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1/testWithMockedMapReduceMultiRegion=eb11a992c540b181cd13c8a05f341a03-5ee55c6a20cd464ca1b5d79ebea03a5a 2023-02-18 15:01:37,446 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] regionserver.HStore(310): Store=eb11a992c540b181cd13c8a05f341a03/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,446 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:37,447 DEBUG [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2 2023-02-18 15:01:37,447 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb11a992c540b181cd13c8a05f341a03 columnFamilyName f2 2023-02-18 15:01:37,450 DEBUG [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2/testWithMockedMapReduceMultiRegion=eb11a992c540b181cd13c8a05f341a03-501655bd03634d9d9192cc3af3efefce 2023-02-18 15:01:37,450 INFO [StoreOpener-eb11a992c540b181cd13c8a05f341a03-1] regionserver.HStore(310): Store=eb11a992c540b181cd13c8a05f341a03/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,451 DEBUG [Listener at localhost/41495] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:37,451 INFO [Listener at localhost/41495] regionserver.HRegion(1071): Opened eb11a992c540b181cd13c8a05f341a03; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59062057, jitterRate=-0.11990676820278168}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:37,451 DEBUG [Listener at localhost/41495] regionserver.HRegion(964): Region open journal for eb11a992c540b181cd13c8a05f341a03: 2023-02-18 15:01:37,458 DEBUG [Listener at localhost/41495] regionserver.HRegion(1603): Closing eb11a992c540b181cd13c8a05f341a03, disabling compactions & flushes 2023-02-18 15:01:37,459 INFO [Listener at localhost/41495] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:37,459 DEBUG [Listener at localhost/41495] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:37,459 DEBUG [Listener at localhost/41495] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. after waiting 0 ms 2023-02-18 15:01:37,459 DEBUG [Listener at localhost/41495] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:37,459 INFO [Listener at localhost/41495] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:37,459 DEBUG [Listener at localhost/41495] regionserver.HRegion(1557): Region close journal for eb11a992c540b181cd13c8a05f341a03: 2023-02-18 15:01:37,460 DEBUG [Listener at localhost/41495] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:37,460 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:37,461 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:37,463 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:37,463 DEBUG [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1 2023-02-18 15:01:37,464 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f00f071a5b247f9c69489550eafadf7e columnFamilyName f1 2023-02-18 15:01:37,467 DEBUG [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1/testWithMockedMapReduceMultiRegion=f00f071a5b247f9c69489550eafadf7e-86676fab505c48218e18a488dc9e4353 2023-02-18 15:01:37,467 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] regionserver.HStore(310): Store=f00f071a5b247f9c69489550eafadf7e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,467 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:37,468 DEBUG [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2 2023-02-18 15:01:37,468 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f00f071a5b247f9c69489550eafadf7e columnFamilyName f2 2023-02-18 15:01:37,472 DEBUG [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2/testWithMockedMapReduceMultiRegion=f00f071a5b247f9c69489550eafadf7e-0202d1b0971f46bfa91a07b89deb02a0 2023-02-18 15:01:37,472 INFO [StoreOpener-f00f071a5b247f9c69489550eafadf7e-1] regionserver.HStore(310): Store=f00f071a5b247f9c69489550eafadf7e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,472 DEBUG [Listener at localhost/41495] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:37,472 INFO [Listener at localhost/41495] regionserver.HRegion(1071): Opened f00f071a5b247f9c69489550eafadf7e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62547219, jitterRate=-0.06797380745410919}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:37,472 DEBUG [Listener at localhost/41495] regionserver.HRegion(964): Region open journal for f00f071a5b247f9c69489550eafadf7e: 2023-02-18 15:01:37,480 DEBUG [Listener at localhost/41495] regionserver.HRegion(1603): Closing f00f071a5b247f9c69489550eafadf7e, disabling compactions & flushes 2023-02-18 15:01:37,480 INFO [Listener at localhost/41495] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:37,480 DEBUG [Listener at localhost/41495] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:37,480 DEBUG [Listener at localhost/41495] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. after waiting 0 ms 2023-02-18 15:01:37,480 DEBUG [Listener at localhost/41495] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:37,481 INFO [Listener at localhost/41495] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:37,481 DEBUG [Listener at localhost/41495] regionserver.HRegion(1557): Region close journal for f00f071a5b247f9c69489550eafadf7e: 2023-02-18 15:01:37,481 DEBUG [Listener at localhost/41495] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:37,481 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:37,482 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:37,484 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:37,484 DEBUG [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1 2023-02-18 15:01:37,485 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3e65d483df1348874accc9495c2f30c columnFamilyName f1 2023-02-18 15:01:37,488 DEBUG [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1/testWithMockedMapReduceMultiRegion=d3e65d483df1348874accc9495c2f30c-d74892400b524ded920fbe226c23b5e1 2023-02-18 15:01:37,488 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] regionserver.HStore(310): Store=d3e65d483df1348874accc9495c2f30c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,488 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:37,489 DEBUG [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2 2023-02-18 15:01:37,489 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3e65d483df1348874accc9495c2f30c columnFamilyName f2 2023-02-18 15:01:37,492 DEBUG [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2/testWithMockedMapReduceMultiRegion=d3e65d483df1348874accc9495c2f30c-dfa0fa380969454e81e37b3c2c325dd3 2023-02-18 15:01:37,492 INFO [StoreOpener-d3e65d483df1348874accc9495c2f30c-1] regionserver.HStore(310): Store=d3e65d483df1348874accc9495c2f30c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,493 DEBUG [Listener at localhost/41495] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:37,493 INFO [Listener at localhost/41495] regionserver.HRegion(1071): Opened d3e65d483df1348874accc9495c2f30c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69610808, jitterRate=0.03728187084197998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:37,493 DEBUG [Listener at localhost/41495] regionserver.HRegion(964): Region open journal for d3e65d483df1348874accc9495c2f30c: 2023-02-18 15:01:37,502 DEBUG [Listener at localhost/41495] regionserver.HRegion(1603): Closing d3e65d483df1348874accc9495c2f30c, disabling compactions & flushes 2023-02-18 15:01:37,502 INFO [Listener at localhost/41495] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:37,502 DEBUG [Listener at localhost/41495] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:37,502 DEBUG [Listener at localhost/41495] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. after waiting 0 ms 2023-02-18 15:01:37,502 DEBUG [Listener at localhost/41495] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:37,503 INFO [Listener at localhost/41495] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:37,503 DEBUG [Listener at localhost/41495] regionserver.HRegion(1557): Region close journal for d3e65d483df1348874accc9495c2f30c: 2023-02-18 15:01:37,503 DEBUG [Listener at localhost/41495] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:37,503 INFO [Listener at localhost/41495] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:37,504 DEBUG [Listener at localhost/41495] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:37,506 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:37,507 DEBUG [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1 2023-02-18 15:01:37,507 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f38c2b0d8bdfee48c79d8e2e48e87f70 columnFamilyName f1 2023-02-18 15:01:37,510 DEBUG [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1/testWithMockedMapReduceMultiRegion=f38c2b0d8bdfee48c79d8e2e48e87f70-0c5ecd05d1d94fde945396d135fd16c6 2023-02-18 15:01:37,510 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] regionserver.HStore(310): Store=f38c2b0d8bdfee48c79d8e2e48e87f70/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,510 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:37,511 DEBUG [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2 2023-02-18 15:01:37,511 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f38c2b0d8bdfee48c79d8e2e48e87f70 columnFamilyName f2 2023-02-18 15:01:37,515 DEBUG [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] regionserver.HStore(539): loaded hdfs://localhost:45869/user/jenkins/test-data/9c6dd072-31df-e6a8-ad02-589903e7ee23/testWithMockedMapReduceMultiRegion/0b833c0d-8b13-4798-8d51-664b3d8f998f/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2/testWithMockedMapReduceMultiRegion=f38c2b0d8bdfee48c79d8e2e48e87f70-76af3a66187140f49ec305abcdb306ea 2023-02-18 15:01:37,515 INFO [StoreOpener-f38c2b0d8bdfee48c79d8e2e48e87f70-1] regionserver.HStore(310): Store=f38c2b0d8bdfee48c79d8e2e48e87f70/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:37,515 DEBUG [Listener at localhost/41495] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:37,515 INFO [Listener at localhost/41495] regionserver.HRegion(1071): Opened f38c2b0d8bdfee48c79d8e2e48e87f70; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70511157, jitterRate=0.050698116421699524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:37,515 DEBUG [Listener at localhost/41495] regionserver.HRegion(964): Region open journal for f38c2b0d8bdfee48c79d8e2e48e87f70: 2023-02-18 15:01:37,523 DEBUG [Listener at localhost/41495] regionserver.HRegion(1603): Closing f38c2b0d8bdfee48c79d8e2e48e87f70, disabling compactions & flushes 2023-02-18 15:01:37,523 INFO [Listener at localhost/41495] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:37,523 DEBUG [Listener at localhost/41495] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:37,523 DEBUG [Listener at localhost/41495] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. after waiting 0 ms 2023-02-18 15:01:37,523 DEBUG [Listener at localhost/41495] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:37,524 INFO [Listener at localhost/41495] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:37,524 DEBUG [Listener at localhost/41495] regionserver.HRegion(1557): Region close journal for f38c2b0d8bdfee48c79d8e2e48e87f70: 2023-02-18 15:01:37,528 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-18 15:01:37,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-18 15:01:37,531 INFO [Listener at localhost/41495] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-18 15:01:37,532 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-18 15:01:37,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:37,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 15:01:37,536 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732497535"}]},"ts":"1676732497535"} 2023-02-18 15:01:37,537 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-18 15:01:37,562 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-18 15:01:37,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=60fcf24038136da91c1222b466e62c4f, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d55cd0811e64abcd9e6fa58191b0fd4, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ac5ba9e0adcd5edd0f46077da3de996, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb11a992c540b181cd13c8a05f341a03, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f38c2b0d8bdfee48c79d8e2e48e87f70, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d097efb1ca5f85b18f735c9483e312b5, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cf5bdeb8bb5eb132408d6e2daa4817d4, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f00f071a5b247f9c69489550eafadf7e, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d3e65d483df1348874accc9495c2f30c, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3dc6e1c27e3ffcaf5419a0eac034619f, UNASSIGN}] 2023-02-18 15:01:37,565 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=60fcf24038136da91c1222b466e62c4f, UNASSIGN 2023-02-18 15:01:37,565 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb11a992c540b181cd13c8a05f341a03, UNASSIGN 2023-02-18 15:01:37,565 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ac5ba9e0adcd5edd0f46077da3de996, UNASSIGN 2023-02-18 15:01:37,565 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d55cd0811e64abcd9e6fa58191b0fd4, UNASSIGN 2023-02-18 15:01:37,565 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3dc6e1c27e3ffcaf5419a0eac034619f, UNASSIGN 2023-02-18 15:01:37,565 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=60fcf24038136da91c1222b466e62c4f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:37,565 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=eb11a992c540b181cd13c8a05f341a03, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:37,566 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676732497565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732497565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732497565"}]},"ts":"1676732497565"} 2023-02-18 15:01:37,566 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732497565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732497565"}]},"ts":"1676732497565"} 2023-02-18 15:01:37,566 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=2ac5ba9e0adcd5edd0f46077da3de996, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:37,566 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732497566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732497566"}]},"ts":"1676732497566"} 2023-02-18 15:01:37,566 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=5d55cd0811e64abcd9e6fa58191b0fd4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:37,566 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3dc6e1c27e3ffcaf5419a0eac034619f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:37,566 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732497566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732497566"}]},"ts":"1676732497566"} 2023-02-18 15:01:37,566 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676732497566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732497566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732497566"}]},"ts":"1676732497566"} 2023-02-18 15:01:37,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=34, state=RUNNABLE; CloseRegionProcedure 60fcf24038136da91c1222b466e62c4f, server=jenkins-hbase4.apache.org,36479,1676732491663}] 2023-02-18 15:01:37,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=37, state=RUNNABLE; CloseRegionProcedure eb11a992c540b181cd13c8a05f341a03, server=jenkins-hbase4.apache.org,38837,1676732491639}] 2023-02-18 15:01:37,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=36, state=RUNNABLE; CloseRegionProcedure 2ac5ba9e0adcd5edd0f46077da3de996, server=jenkins-hbase4.apache.org,36479,1676732491663}] 2023-02-18 15:01:37,569 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure 5d55cd0811e64abcd9e6fa58191b0fd4, server=jenkins-hbase4.apache.org,38837,1676732491639}] 2023-02-18 15:01:37,570 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d3e65d483df1348874accc9495c2f30c, UNASSIGN 2023-02-18 15:01:37,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 3dc6e1c27e3ffcaf5419a0eac034619f, server=jenkins-hbase4.apache.org,36479,1676732491663}] 2023-02-18 15:01:37,570 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=d3e65d483df1348874accc9495c2f30c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:37,570 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f00f071a5b247f9c69489550eafadf7e, UNASSIGN 2023-02-18 15:01:37,570 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497570"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732497570"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732497570"}]},"ts":"1676732497570"} 2023-02-18 15:01:37,570 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cf5bdeb8bb5eb132408d6e2daa4817d4, UNASSIGN 2023-02-18 15:01:37,571 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=f00f071a5b247f9c69489550eafadf7e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:37,571 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497571"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732497571"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732497571"}]},"ts":"1676732497571"} 2023-02-18 15:01:37,571 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=cf5bdeb8bb5eb132408d6e2daa4817d4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:37,571 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497571"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732497571"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732497571"}]},"ts":"1676732497571"} 2023-02-18 15:01:37,571 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d097efb1ca5f85b18f735c9483e312b5, UNASSIGN 2023-02-18 15:01:37,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure d3e65d483df1348874accc9495c2f30c, server=jenkins-hbase4.apache.org,38837,1676732491639}] 2023-02-18 15:01:37,572 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f38c2b0d8bdfee48c79d8e2e48e87f70, UNASSIGN 2023-02-18 15:01:37,572 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=d097efb1ca5f85b18f735c9483e312b5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:37,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure f00f071a5b247f9c69489550eafadf7e, server=jenkins-hbase4.apache.org,38837,1676732491639}] 2023-02-18 15:01:37,572 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497572"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732497572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732497572"}]},"ts":"1676732497572"} 2023-02-18 15:01:37,572 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f38c2b0d8bdfee48c79d8e2e48e87f70, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:37,573 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497572"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732497572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732497572"}]},"ts":"1676732497572"} 2023-02-18 15:01:37,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure cf5bdeb8bb5eb132408d6e2daa4817d4, server=jenkins-hbase4.apache.org,36479,1676732491663}] 2023-02-18 15:01:37,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure d097efb1ca5f85b18f735c9483e312b5, server=jenkins-hbase4.apache.org,38837,1676732491639}] 2023-02-18 15:01:37,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure f38c2b0d8bdfee48c79d8e2e48e87f70, server=jenkins-hbase4.apache.org,36479,1676732491663}] 2023-02-18 15:01:37,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 15:01:37,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:37,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:37,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f38c2b0d8bdfee48c79d8e2e48e87f70, disabling compactions & flushes 2023-02-18 15:01:37,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d3e65d483df1348874accc9495c2f30c, disabling compactions & flushes 2023-02-18 15:01:37,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:37,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:37,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:37,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. after waiting 0 ms 2023-02-18 15:01:37,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:37,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:37,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. after waiting 0 ms 2023-02-18 15:01:37,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:37,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:37,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c. 2023-02-18 15:01:37,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d3e65d483df1348874accc9495c2f30c: 2023-02-18 15:01:37,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:37,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:37,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d097efb1ca5f85b18f735c9483e312b5, disabling compactions & flushes 2023-02-18 15:01:37,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:37,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:37,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. after waiting 0 ms 2023-02-18 15:01:37,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:37,727 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=d3e65d483df1348874accc9495c2f30c, regionState=CLOSED 2023-02-18 15:01:37,727 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732497727"}]},"ts":"1676732497727"} 2023-02-18 15:01:37,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:37,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70. 2023-02-18 15:01:37,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f38c2b0d8bdfee48c79d8e2e48e87f70: 2023-02-18 15:01:37,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:37,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5. 2023-02-18 15:01:37,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d097efb1ca5f85b18f735c9483e312b5: 2023-02-18 15:01:37,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:37,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:37,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3dc6e1c27e3ffcaf5419a0eac034619f, disabling compactions & flushes 2023-02-18 15:01:37,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:37,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:37,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. after waiting 0 ms 2023-02-18 15:01:37,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:37,737 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f38c2b0d8bdfee48c79d8e2e48e87f70, regionState=CLOSED 2023-02-18 15:01:37,737 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732497737"}]},"ts":"1676732497737"} 2023-02-18 15:01:37,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-18 15:01:37,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure d3e65d483df1348874accc9495c2f30c, server=jenkins-hbase4.apache.org,38837,1676732491639 in 156 msec 2023-02-18 15:01:37,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:37,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:37,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5d55cd0811e64abcd9e6fa58191b0fd4, disabling compactions & flushes 2023-02-18 15:01:37,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:37,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:37,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. after waiting 0 ms 2023-02-18 15:01:37,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:37,739 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=d097efb1ca5f85b18f735c9483e312b5, regionState=CLOSED 2023-02-18 15:01:37,739 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732497739"}]},"ts":"1676732497739"} 2023-02-18 15:01:37,740 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d3e65d483df1348874accc9495c2f30c, UNASSIGN in 175 msec 2023-02-18 15:01:37,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-18 15:01:37,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure f38c2b0d8bdfee48c79d8e2e48e87f70, server=jenkins-hbase4.apache.org,36479,1676732491663 in 162 msec 2023-02-18 15:01:37,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-18 15:01:37,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure d097efb1ca5f85b18f735c9483e312b5, server=jenkins-hbase4.apache.org,38837,1676732491639 in 167 msec 2023-02-18 15:01:37,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f38c2b0d8bdfee48c79d8e2e48e87f70, UNASSIGN in 178 msec 2023-02-18 15:01:37,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d097efb1ca5f85b18f735c9483e312b5, UNASSIGN in 179 msec 2023-02-18 15:01:37,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 15:01:37,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:37,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4. 2023-02-18 15:01:37,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f. 2023-02-18 15:01:37,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3dc6e1c27e3ffcaf5419a0eac034619f: 2023-02-18 15:01:37,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5d55cd0811e64abcd9e6fa58191b0fd4: 2023-02-18 15:01:37,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:37,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:37,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing eb11a992c540b181cd13c8a05f341a03, disabling compactions & flushes 2023-02-18 15:01:37,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:37,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:37,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. after waiting 0 ms 2023-02-18 15:01:37,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:37,758 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=5d55cd0811e64abcd9e6fa58191b0fd4, regionState=CLOSED 2023-02-18 15:01:37,759 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497758"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732497758"}]},"ts":"1676732497758"} 2023-02-18 15:01:37,759 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3dc6e1c27e3ffcaf5419a0eac034619f, regionState=CLOSED 2023-02-18 15:01:37,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:37,760 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676732497759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732497759"}]},"ts":"1676732497759"} 2023-02-18 15:01:37,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:37,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 60fcf24038136da91c1222b466e62c4f, disabling compactions & flushes 2023-02-18 15:01:37,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:37,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:37,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. after waiting 0 ms 2023-02-18 15:01:37,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:37,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-18 15:01:37,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure 5d55cd0811e64abcd9e6fa58191b0fd4, server=jenkins-hbase4.apache.org,38837,1676732491639 in 192 msec 2023-02-18 15:01:37,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:37,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-18 15:01:37,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 3dc6e1c27e3ffcaf5419a0eac034619f, server=jenkins-hbase4.apache.org,36479,1676732491663 in 192 msec 2023-02-18 15:01:37,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d55cd0811e64abcd9e6fa58191b0fd4, UNASSIGN in 200 msec 2023-02-18 15:01:37,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3dc6e1c27e3ffcaf5419a0eac034619f, UNASSIGN in 201 msec 2023-02-18 15:01:37,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03. 2023-02-18 15:01:37,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for eb11a992c540b181cd13c8a05f341a03: 2023-02-18 15:01:37,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 15:01:37,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f. 2023-02-18 15:01:37,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 60fcf24038136da91c1222b466e62c4f: 2023-02-18 15:01:37,770 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=eb11a992c540b181cd13c8a05f341a03, regionState=CLOSED 2023-02-18 15:01:37,770 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732497770"}]},"ts":"1676732497770"} 2023-02-18 15:01:37,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:37,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:37,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2ac5ba9e0adcd5edd0f46077da3de996, disabling compactions & flushes 2023-02-18 15:01:37,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:37,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:37,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. after waiting 0 ms 2023-02-18 15:01:37,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:37,771 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=60fcf24038136da91c1222b466e62c4f, regionState=CLOSED 2023-02-18 15:01:37,771 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676732497771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732497771"}]},"ts":"1676732497771"} 2023-02-18 15:01:37,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:37,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:37,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f00f071a5b247f9c69489550eafadf7e, disabling compactions & flushes 2023-02-18 15:01:37,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:37,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:37,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. after waiting 0 ms 2023-02-18 15:01:37,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:37,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=37 2023-02-18 15:01:37,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=37, state=SUCCESS; CloseRegionProcedure eb11a992c540b181cd13c8a05f341a03, server=jenkins-hbase4.apache.org,38837,1676732491639 in 209 msec 2023-02-18 15:01:37,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=34 2023-02-18 15:01:37,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=34, state=SUCCESS; CloseRegionProcedure 60fcf24038136da91c1222b466e62c4f, server=jenkins-hbase4.apache.org,36479,1676732491663 in 212 msec 2023-02-18 15:01:37,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:37,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:37,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb11a992c540b181cd13c8a05f341a03, UNASSIGN in 218 msec 2023-02-18 15:01:37,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996. 2023-02-18 15:01:37,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2ac5ba9e0adcd5edd0f46077da3de996: 2023-02-18 15:01:37,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e. 2023-02-18 15:01:37,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f00f071a5b247f9c69489550eafadf7e: 2023-02-18 15:01:37,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=60fcf24038136da91c1222b466e62c4f, UNASSIGN in 219 msec 2023-02-18 15:01:37,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:37,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:37,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cf5bdeb8bb5eb132408d6e2daa4817d4, disabling compactions & flushes 2023-02-18 15:01:37,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:37,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:37,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. after waiting 0 ms 2023-02-18 15:01:37,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:37,785 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=2ac5ba9e0adcd5edd0f46077da3de996, regionState=CLOSED 2023-02-18 15:01:37,785 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497785"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732497785"}]},"ts":"1676732497785"} 2023-02-18 15:01:37,785 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=f00f071a5b247f9c69489550eafadf7e, regionState=CLOSED 2023-02-18 15:01:37,786 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497785"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732497785"}]},"ts":"1676732497785"} 2023-02-18 15:01:37,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:37,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=36 2023-02-18 15:01:37,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=36, state=SUCCESS; CloseRegionProcedure 2ac5ba9e0adcd5edd0f46077da3de996, server=jenkins-hbase4.apache.org,36479,1676732491663 in 218 msec 2023-02-18 15:01:37,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-18 15:01:37,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure f00f071a5b247f9c69489550eafadf7e, server=jenkins-hbase4.apache.org,38837,1676732491639 in 215 msec 2023-02-18 15:01:37,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ac5ba9e0adcd5edd0f46077da3de996, UNASSIGN in 225 msec 2023-02-18 15:01:37,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f00f071a5b247f9c69489550eafadf7e, UNASSIGN in 225 msec 2023-02-18 15:01:37,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:37,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4. 2023-02-18 15:01:37,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cf5bdeb8bb5eb132408d6e2daa4817d4: 2023-02-18 15:01:37,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:37,800 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=cf5bdeb8bb5eb132408d6e2daa4817d4, regionState=CLOSED 2023-02-18 15:01:37,801 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676732497800"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732497800"}]},"ts":"1676732497800"} 2023-02-18 15:01:37,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-18 15:01:37,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure cf5bdeb8bb5eb132408d6e2daa4817d4, server=jenkins-hbase4.apache.org,36479,1676732491663 in 229 msec 2023-02-18 15:01:37,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=33 2023-02-18 15:01:37,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cf5bdeb8bb5eb132408d6e2daa4817d4, UNASSIGN in 240 msec 2023-02-18 15:01:37,805 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732497804"}]},"ts":"1676732497804"} 2023-02-18 15:01:37,806 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-18 15:01:37,807 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-18 15:01:37,808 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 276 msec 2023-02-18 15:01:37,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 15:01:37,838 INFO [Listener at localhost/41495] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-18 15:01:37,839 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-18 15:01:37,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:37,841 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:37,842 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:37,842 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 15:01:37,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 15:01:37,851 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:37,851 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:37,851 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:37,851 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:37,851 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:37,852 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:37,851 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:37,852 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:37,855 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/recovered.edits] 2023-02-18 15:01:37,856 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/recovered.edits] 2023-02-18 15:01:37,856 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/recovered.edits] 2023-02-18 15:01:37,856 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/recovered.edits] 2023-02-18 15:01:37,856 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/f1, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/f2, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/recovered.edits] 2023-02-18 15:01:37,856 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/recovered.edits] 2023-02-18 15:01:37,857 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/recovered.edits] 2023-02-18 15:01:37,857 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/recovered.edits] 2023-02-18 15:01:37,864 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1/0062bbe168274bfa914581a593c2ff16 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1/0062bbe168274bfa914581a593c2ff16 2023-02-18 15:01:37,864 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1/0c5ecd05d1d94fde945396d135fd16c6 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1/0c5ecd05d1d94fde945396d135fd16c6 2023-02-18 15:01:37,864 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1/8629b2c5258747e790b6b5155c6901e1 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1/8629b2c5258747e790b6b5155c6901e1 2023-02-18 15:01:37,865 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1/5ee55c6a20cd464ca1b5d79ebea03a5a to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1/5ee55c6a20cd464ca1b5d79ebea03a5a 2023-02-18 15:01:37,865 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1/8a484a1ea6954f0380524535edf43218 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1/8a484a1ea6954f0380524535edf43218 2023-02-18 15:01:37,866 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1/5de26e413ae84c4989fd37d5c32a1767 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1/5de26e413ae84c4989fd37d5c32a1767 2023-02-18 15:01:37,868 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1/d4e135dcfe594eeb8f9a763c521d9a6b to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f1/d4e135dcfe594eeb8f9a763c521d9a6b 2023-02-18 15:01:37,868 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1/1386db8701424419b5a5f3299705e684 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1/1386db8701424419b5a5f3299705e684 2023-02-18 15:01:37,868 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1/a538b7380865426b82299bef0391175d to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f1/a538b7380865426b82299bef0391175d 2023-02-18 15:01:37,868 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1/54fff0caacbb409a97ec5965622a08f5 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f1/54fff0caacbb409a97ec5965622a08f5 2023-02-18 15:01:37,869 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1/a967d3a7cb39468893ba6dbd545e0e9a to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f1/a967d3a7cb39468893ba6dbd545e0e9a 2023-02-18 15:01:37,870 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1/6c1e76f6f8dc4bb6a422672c0b94edbd to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f1/6c1e76f6f8dc4bb6a422672c0b94edbd 2023-02-18 15:01:37,870 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1/eb2333cd2c6d43bfa2fdf78977a76182 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f1/eb2333cd2c6d43bfa2fdf78977a76182 2023-02-18 15:01:37,871 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1/86676fab505c48218e18a488dc9e4353 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f1/86676fab505c48218e18a488dc9e4353 2023-02-18 15:01:37,871 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/recovered.edits/6.seqid to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f/recovered.edits/6.seqid 2023-02-18 15:01:37,872 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/60fcf24038136da91c1222b466e62c4f 2023-02-18 15:01:37,872 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:37,875 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2/07c3e9e482124a21b6b984d9cd8975bb to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2/07c3e9e482124a21b6b984d9cd8975bb 2023-02-18 15:01:37,875 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/recovered.edits] 2023-02-18 15:01:37,876 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2/d9144bbb42ea4f8ab23168ae262e257c to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2/d9144bbb42ea4f8ab23168ae262e257c 2023-02-18 15:01:37,876 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2/01ef97c9f7be4121b15e42182701288c to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2/01ef97c9f7be4121b15e42182701288c 2023-02-18 15:01:37,876 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2/501655bd03634d9d9192cc3af3efefce to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2/501655bd03634d9d9192cc3af3efefce 2023-02-18 15:01:37,877 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2/0202d1b0971f46bfa91a07b89deb02a0 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2/0202d1b0971f46bfa91a07b89deb02a0 2023-02-18 15:01:37,878 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2/ffdc192703d24678be0ab782b89715d1 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/f2/ffdc192703d24678be0ab782b89715d1 2023-02-18 15:01:37,878 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2/b1ada03bf8904371a96dbe1dfc0296d2 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2/b1ada03bf8904371a96dbe1dfc0296d2 2023-02-18 15:01:37,878 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2/76af3a66187140f49ec305abcdb306ea to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/f2/76af3a66187140f49ec305abcdb306ea 2023-02-18 15:01:37,878 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2/abd87e2424e04b4382c50b9e69c1f1be to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2/abd87e2424e04b4382c50b9e69c1f1be 2023-02-18 15:01:37,879 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2/f654fab3d41345e899995517a35ac9e4 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/f2/f654fab3d41345e899995517a35ac9e4 2023-02-18 15:01:37,880 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2/ba5034045204450b987b95d47e0ac4f8 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/f2/ba5034045204450b987b95d47e0ac4f8 2023-02-18 15:01:37,880 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2/38fd7e01bf8546b68dec9384dd0c732a to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/f2/38fd7e01bf8546b68dec9384dd0c732a 2023-02-18 15:01:37,881 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2/edce0a73978e4a1aaac00c482891060a to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/f2/edce0a73978e4a1aaac00c482891060a 2023-02-18 15:01:37,882 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2/f69c7a42ffc743e3aabb0cbe157888d5 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/f2/f69c7a42ffc743e3aabb0cbe157888d5 2023-02-18 15:01:37,884 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1/d74892400b524ded920fbe226c23b5e1 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1/d74892400b524ded920fbe226c23b5e1 2023-02-18 15:01:37,885 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/recovered.edits/12.seqid to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996/recovered.edits/12.seqid 2023-02-18 15:01:37,886 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ac5ba9e0adcd5edd0f46077da3de996 2023-02-18 15:01:37,887 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:37,887 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/recovered.edits/12.seqid to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03/recovered.edits/12.seqid 2023-02-18 15:01:37,887 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/recovered.edits/12.seqid to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70/recovered.edits/12.seqid 2023-02-18 15:01:37,887 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1/dd738b4ca0d64095946aa0c3a060c183 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f1/dd738b4ca0d64095946aa0c3a060c183 2023-02-18 15:01:37,888 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/recovered.edits/12.seqid to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4/recovered.edits/12.seqid 2023-02-18 15:01:37,888 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb11a992c540b181cd13c8a05f341a03 2023-02-18 15:01:37,896 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/cf5bdeb8bb5eb132408d6e2daa4817d4 2023-02-18 15:01:37,896 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f38c2b0d8bdfee48c79d8e2e48e87f70 2023-02-18 15:01:37,896 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/recovered.edits/12.seqid to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e/recovered.edits/12.seqid 2023-02-18 15:01:37,897 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/recovered.edits/12.seqid to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4/recovered.edits/12.seqid 2023-02-18 15:01:37,897 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/f00f071a5b247f9c69489550eafadf7e 2023-02-18 15:01:37,897 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/recovered.edits/12.seqid to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5/recovered.edits/12.seqid 2023-02-18 15:01:37,898 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d55cd0811e64abcd9e6fa58191b0fd4 2023-02-18 15:01:37,898 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/f1, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/f2, FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/recovered.edits] 2023-02-18 15:01:37,898 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d097efb1ca5f85b18f735c9483e312b5 2023-02-18 15:01:37,899 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2/88ec45b833cf4a1e9eb7a1bf5450823f to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2/88ec45b833cf4a1e9eb7a1bf5450823f 2023-02-18 15:01:37,901 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2/dfa0fa380969454e81e37b3c2c325dd3 to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/f2/dfa0fa380969454e81e37b3c2c325dd3 2023-02-18 15:01:37,903 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/recovered.edits/6.seqid to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f/recovered.edits/6.seqid 2023-02-18 15:01:37,903 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/recovered.edits/12.seqid to hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/archive/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c/recovered.edits/12.seqid 2023-02-18 15:01:37,903 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/3dc6e1c27e3ffcaf5419a0eac034619f 2023-02-18 15:01:37,903 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/.tmp/data/default/testWithMockedMapReduceMultiRegion/d3e65d483df1348874accc9495c2f30c 2023-02-18 15:01:37,903 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-18 15:01:37,905 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:37,908 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-18 15:01:37,912 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-18 15:01:37,912 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:37,912 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-18 15:01:37,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732497912"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:37,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732497912"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:37,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732497912"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:37,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732497912"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:37,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732497912"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:37,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732497912"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:37,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732497912"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:37,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732497912"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:37,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732497912"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:37,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732497912"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:37,915 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-18 15:01:37,915 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 60fcf24038136da91c1222b466e62c4f, NAME => 'testWithMockedMapReduceMultiRegion,,1676732493008.60fcf24038136da91c1222b466e62c4f.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 5d55cd0811e64abcd9e6fa58191b0fd4, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676732493008.5d55cd0811e64abcd9e6fa58191b0fd4.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 2ac5ba9e0adcd5edd0f46077da3de996, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676732493008.2ac5ba9e0adcd5edd0f46077da3de996.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => eb11a992c540b181cd13c8a05f341a03, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676732493008.eb11a992c540b181cd13c8a05f341a03.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => f38c2b0d8bdfee48c79d8e2e48e87f70, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676732493008.f38c2b0d8bdfee48c79d8e2e48e87f70.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => d097efb1ca5f85b18f735c9483e312b5, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676732493008.d097efb1ca5f85b18f735c9483e312b5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => cf5bdeb8bb5eb132408d6e2daa4817d4, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676732493008.cf5bdeb8bb5eb132408d6e2daa4817d4.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => f00f071a5b247f9c69489550eafadf7e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676732493008.f00f071a5b247f9c69489550eafadf7e.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => d3e65d483df1348874accc9495c2f30c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676732493008.d3e65d483df1348874accc9495c2f30c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 3dc6e1c27e3ffcaf5419a0eac034619f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676732493008.3dc6e1c27e3ffcaf5419a0eac034619f.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-18 15:01:37,915 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-18 15:01:37,915 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676732497915"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:37,916 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-18 15:01:37,919 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 15:01:37,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 80 msec 2023-02-18 15:01:37,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40113] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 15:01:37,944 INFO [Listener at localhost/41495] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-18 15:01:37,944 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 15:01:37,944 INFO [Listener at localhost/41495] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 15:01:37,944 DEBUG [Listener at localhost/41495] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65bb1be1 to 127.0.0.1:61834 2023-02-18 15:01:37,944 DEBUG [Listener at localhost/41495] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:37,944 DEBUG [Listener at localhost/41495] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 15:01:37,944 DEBUG [Listener at localhost/41495] util.JVMClusterUtil(257): Found active master hash=1070333671, stopped=false 2023-02-18 15:01:37,944 INFO [Listener at localhost/41495] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40113,1676732491599 2023-02-18 15:01:37,946 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:37,946 INFO [Listener at localhost/41495] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 15:01:37,946 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:37,946 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:37,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:37,946 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:37,948 DEBUG [Listener at localhost/41495] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4817a437 to 127.0.0.1:61834 2023-02-18 15:01:37,948 DEBUG [Listener at localhost/41495] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:37,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:37,948 INFO [Listener at localhost/41495] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38837,1676732491639' ***** 2023-02-18 15:01:37,948 INFO [Listener at localhost/41495] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:37,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:37,948 INFO [Listener at localhost/41495] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36479,1676732491663' ***** 2023-02-18 15:01:37,949 INFO [Listener at localhost/41495] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:37,949 INFO [RS:0;jenkins-hbase4:38837] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:37,949 INFO [RS:0;jenkins-hbase4:38837] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:37,949 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:37,949 INFO [RS:1;jenkins-hbase4:36479] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:37,950 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:37,950 INFO [RS:1;jenkins-hbase4:36479] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:37,951 INFO [RS:1;jenkins-hbase4:36479] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:37,951 INFO [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(3304): Received CLOSE for 6243c5abc898167a77b6ca10818e29c1 2023-02-18 15:01:37,951 INFO [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:37,951 DEBUG [RS:1;jenkins-hbase4:36479] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bdf73ea to 127.0.0.1:61834 2023-02-18 15:01:37,949 INFO [RS:0;jenkins-hbase4:38837] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:37,952 DEBUG [RS:1;jenkins-hbase4:36479] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:37,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6243c5abc898167a77b6ca10818e29c1, disabling compactions & flushes 2023-02-18 15:01:37,950 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:37,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:37,952 INFO [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 15:01:37,952 INFO [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:37,953 DEBUG [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1479): Online Regions={6243c5abc898167a77b6ca10818e29c1=hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1.} 2023-02-18 15:01:37,953 DEBUG [RS:0;jenkins-hbase4:38837] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f854efb to 127.0.0.1:61834 2023-02-18 15:01:37,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:37,953 DEBUG [RS:0;jenkins-hbase4:38837] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:37,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. after waiting 0 ms 2023-02-18 15:01:37,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:37,953 DEBUG [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1505): Waiting on 6243c5abc898167a77b6ca10818e29c1 2023-02-18 15:01:37,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 6243c5abc898167a77b6ca10818e29c1 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 15:01:37,953 INFO [RS:0;jenkins-hbase4:38837] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:37,953 INFO [RS:0;jenkins-hbase4:38837] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:37,953 INFO [RS:0;jenkins-hbase4:38837] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:37,953 INFO [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 15:01:37,953 INFO [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 15:01:37,953 DEBUG [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-18 15:01:37,953 DEBUG [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-18 15:01:37,955 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:37,955 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:37,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:37,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:37,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:37,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:37,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-18 15:01:37,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1/.tmp/info/5705be49a78847339fd2dbe5b8898869 2023-02-18 15:01:37,964 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/.tmp/info/f63ab4d66e9d4ea59b5a628c3a93d101 2023-02-18 15:01:37,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f63ab4d66e9d4ea59b5a628c3a93d101 2023-02-18 15:01:37,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1/.tmp/info/5705be49a78847339fd2dbe5b8898869 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1/info/5705be49a78847339fd2dbe5b8898869 2023-02-18 15:01:37,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1/info/5705be49a78847339fd2dbe5b8898869, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 15:01:37,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6243c5abc898167a77b6ca10818e29c1 in 19ms, sequenceid=6, compaction requested=false 2023-02-18 15:01:37,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/.tmp/rep_barrier/b1f822303b32445a87f68195cff3a000 2023-02-18 15:01:37,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/namespace/6243c5abc898167a77b6ca10818e29c1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 15:01:37,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:37,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6243c5abc898167a77b6ca10818e29c1: 2023-02-18 15:01:37,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676732492353.6243c5abc898167a77b6ca10818e29c1. 2023-02-18 15:01:37,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1f822303b32445a87f68195cff3a000 2023-02-18 15:01:37,986 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/.tmp/table/ae987c9c0e084e6898efbea5e9b54ef9 2023-02-18 15:01:37,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae987c9c0e084e6898efbea5e9b54ef9 2023-02-18 15:01:37,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/.tmp/info/f63ab4d66e9d4ea59b5a628c3a93d101 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/info/f63ab4d66e9d4ea59b5a628c3a93d101 2023-02-18 15:01:37,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f63ab4d66e9d4ea59b5a628c3a93d101 2023-02-18 15:01:37,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/info/f63ab4d66e9d4ea59b5a628c3a93d101, entries=30, sequenceid=57, filesize=8.3 K 2023-02-18 15:01:37,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/.tmp/rep_barrier/b1f822303b32445a87f68195cff3a000 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/rep_barrier/b1f822303b32445a87f68195cff3a000 2023-02-18 15:01:37,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1f822303b32445a87f68195cff3a000 2023-02-18 15:01:37,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/rep_barrier/b1f822303b32445a87f68195cff3a000, entries=10, sequenceid=57, filesize=6.1 K 2023-02-18 15:01:37,999 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/.tmp/table/ae987c9c0e084e6898efbea5e9b54ef9 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/table/ae987c9c0e084e6898efbea5e9b54ef9 2023-02-18 15:01:38,002 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae987c9c0e084e6898efbea5e9b54ef9 2023-02-18 15:01:38,002 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/table/ae987c9c0e084e6898efbea5e9b54ef9, entries=13, sequenceid=57, filesize=6.1 K 2023-02-18 15:01:38,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 47ms, sequenceid=57, compaction requested=false 2023-02-18 15:01:38,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-18 15:01:38,007 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 15:01:38,008 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:38,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:38,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:38,153 INFO [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36479,1676732491663; all regions closed. 2023-02-18 15:01:38,155 INFO [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38837,1676732491639; all regions closed. 2023-02-18 15:01:38,157 DEBUG [RS:1;jenkins-hbase4:36479] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/oldWALs 2023-02-18 15:01:38,157 INFO [RS:1;jenkins-hbase4:36479] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36479%2C1676732491663:(num 1676732492747) 2023-02-18 15:01:38,157 DEBUG [RS:1;jenkins-hbase4:36479] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:38,157 INFO [RS:1;jenkins-hbase4:36479] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:38,157 INFO [RS:1;jenkins-hbase4:36479] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:38,157 INFO [RS:1;jenkins-hbase4:36479] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:38,157 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:38,157 INFO [RS:1;jenkins-hbase4:36479] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:38,158 INFO [RS:1;jenkins-hbase4:36479] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:38,159 INFO [RS:1;jenkins-hbase4:36479] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36479 2023-02-18 15:01:38,160 DEBUG [RS:0;jenkins-hbase4:38837] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/oldWALs 2023-02-18 15:01:38,160 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:38,160 INFO [RS:0;jenkins-hbase4:38837] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38837%2C1676732491639.meta:.meta(num 1676732492273) 2023-02-18 15:01:38,161 ERROR [Listener at localhost/41495-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14b8833e rejected from java.util.concurrent.ThreadPoolExecutor@10871571[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:38,161 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:38,160 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:38,160 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36479,1676732491663 2023-02-18 15:01:38,161 ERROR [Listener at localhost/41495-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34eb6ac2 rejected from java.util.concurrent.ThreadPoolExecutor@10871571[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:38,161 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:38,162 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36479,1676732491663] 2023-02-18 15:01:38,162 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36479,1676732491663; numProcessing=1 2023-02-18 15:01:38,165 DEBUG [RS:0;jenkins-hbase4:38837] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/oldWALs 2023-02-18 15:01:38,165 INFO [RS:0;jenkins-hbase4:38837] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38837%2C1676732491639:(num 1676732492974) 2023-02-18 15:01:38,165 DEBUG [RS:0;jenkins-hbase4:38837] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:38,165 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36479,1676732491663 already deleted, retry=false 2023-02-18 15:01:38,165 INFO [RS:0;jenkins-hbase4:38837] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:38,165 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36479,1676732491663 expired; onlineServers=1 2023-02-18 15:01:38,165 INFO [RS:0;jenkins-hbase4:38837] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:38,165 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:38,166 INFO [RS:0;jenkins-hbase4:38837] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38837 2023-02-18 15:01:38,168 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38837,1676732491639 2023-02-18 15:01:38,168 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:38,168 ERROR [Listener at localhost/41495-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@507c6d42 rejected from java.util.concurrent.ThreadPoolExecutor@5443e395[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:38,169 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38837,1676732491639] 2023-02-18 15:01:38,169 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38837,1676732491639; numProcessing=2 2023-02-18 15:01:38,170 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38837,1676732491639 already deleted, retry=false 2023-02-18 15:01:38,170 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38837,1676732491639 expired; onlineServers=0 2023-02-18 15:01:38,170 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40113,1676732491599' ***** 2023-02-18 15:01:38,170 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 15:01:38,171 DEBUG [M:0;jenkins-hbase4:40113] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bf47dc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:38,171 INFO [M:0;jenkins-hbase4:40113] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40113,1676732491599 2023-02-18 15:01:38,171 INFO [M:0;jenkins-hbase4:40113] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40113,1676732491599; all regions closed. 2023-02-18 15:01:38,171 DEBUG [M:0;jenkins-hbase4:40113] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:38,171 DEBUG [M:0;jenkins-hbase4:40113] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 15:01:38,171 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 15:01:38,171 DEBUG [M:0;jenkins-hbase4:40113] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 15:01:38,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732491882] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732491882,5,FailOnTimeoutGroup] 2023-02-18 15:01:38,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732491881] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732491881,5,FailOnTimeoutGroup] 2023-02-18 15:01:38,171 INFO [M:0;jenkins-hbase4:40113] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 15:01:38,173 INFO [M:0;jenkins-hbase4:40113] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 15:01:38,173 INFO [M:0;jenkins-hbase4:40113] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 15:01:38,173 DEBUG [M:0;jenkins-hbase4:40113] master.HMaster(1512): Stopping service threads 2023-02-18 15:01:38,173 INFO [M:0;jenkins-hbase4:40113] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 15:01:38,174 ERROR [M:0;jenkins-hbase4:40113] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 15:01:38,174 INFO [M:0;jenkins-hbase4:40113] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 15:01:38,174 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 15:01:38,175 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:38,175 DEBUG [M:0;jenkins-hbase4:40113] zookeeper.ZKUtil(398): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 15:01:38,175 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:38,175 WARN [M:0;jenkins-hbase4:40113] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 15:01:38,175 INFO [M:0;jenkins-hbase4:40113] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 15:01:38,176 INFO [M:0;jenkins-hbase4:40113] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 15:01:38,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:38,176 DEBUG [M:0;jenkins-hbase4:40113] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:38,176 INFO [M:0;jenkins-hbase4:40113] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:38,176 DEBUG [M:0;jenkins-hbase4:40113] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:38,176 DEBUG [M:0;jenkins-hbase4:40113] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:38,176 DEBUG [M:0;jenkins-hbase4:40113] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:38,176 INFO [M:0;jenkins-hbase4:40113] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.14 KB heapSize=200.04 KB 2023-02-18 15:01:38,185 INFO [M:0;jenkins-hbase4:40113] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.14 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/11cd0267aa18430db296a84f7df97cb6 2023-02-18 15:01:38,191 DEBUG [M:0;jenkins-hbase4:40113] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/11cd0267aa18430db296a84f7df97cb6 as hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/11cd0267aa18430db296a84f7df97cb6 2023-02-18 15:01:38,194 INFO [M:0;jenkins-hbase4:40113] regionserver.HStore(1080): Added hdfs://localhost:45869/user/jenkins/test-data/0031cb67-20e7-947c-1355-f3e24a5ec905/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/11cd0267aa18430db296a84f7df97cb6, entries=53, sequenceid=357, filesize=10.7 K 2023-02-18 15:01:38,195 INFO [M:0;jenkins-hbase4:40113] regionserver.HRegion(2947): Finished flush of dataSize ~167.14 KB/171153, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=357, compaction requested=false 2023-02-18 15:01:38,195 INFO [M:0;jenkins-hbase4:40113] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:38,195 DEBUG [M:0;jenkins-hbase4:40113] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:38,197 INFO [M:0;jenkins-hbase4:40113] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 15:01:38,197 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:38,198 INFO [M:0;jenkins-hbase4:40113] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40113 2023-02-18 15:01:38,201 DEBUG [M:0;jenkins-hbase4:40113] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40113,1676732491599 already deleted, retry=false 2023-02-18 15:01:38,447 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:38,447 INFO [M:0;jenkins-hbase4:40113] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40113,1676732491599; zookeeper connection closed. 2023-02-18 15:01:38,447 ERROR [Listener at localhost/41495-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3629d48b rejected from java.util.concurrent.ThreadPoolExecutor@32165696[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:38,448 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): master:40113-0x10067f351010000, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:38,448 ERROR [Listener at localhost/41495-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3edcdcb9 rejected from java.util.concurrent.ThreadPoolExecutor@32165696[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:38,547 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:38,547 INFO [RS:0;jenkins-hbase4:38837] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38837,1676732491639; zookeeper connection closed. 2023-02-18 15:01:38,547 ERROR [Listener at localhost/41495-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13bf3914 rejected from java.util.concurrent.ThreadPoolExecutor@5443e395[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:38,547 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:38837-0x10067f351010001, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:38,547 ERROR [Listener at localhost/41495-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b0e5081 rejected from java.util.concurrent.ThreadPoolExecutor@5443e395[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:38,547 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@e409d5f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@e409d5f 2023-02-18 15:01:38,590 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 15:01:38,647 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:38,647 INFO [RS:1;jenkins-hbase4:36479] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36479,1676732491663; zookeeper connection closed. 2023-02-18 15:01:38,647 ERROR [Listener at localhost/41495-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c9e037d rejected from java.util.concurrent.ThreadPoolExecutor@10871571[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:38,647 DEBUG [Listener at localhost/41495-EventThread] zookeeper.ZKWatcher(600): regionserver:36479-0x10067f351010002, quorum=127.0.0.1:61834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:38,647 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5c95d57c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5c95d57c 2023-02-18 15:01:38,647 ERROR [Listener at localhost/41495-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a78b747 rejected from java.util.concurrent.ThreadPoolExecutor@10871571[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:38,648 INFO [Listener at localhost/41495] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 15:01:38,649 WARN [Listener at localhost/41495] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:38,653 INFO [Listener at localhost/41495] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:38,758 WARN [BP-291229437-172.31.14.131-1676732491004 heartbeating to localhost/127.0.0.1:45869] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:38,759 WARN [BP-291229437-172.31.14.131-1676732491004 heartbeating to localhost/127.0.0.1:45869] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-291229437-172.31.14.131-1676732491004 (Datanode Uuid d0832c41-ad5e-41a6-acd8-e51100ab5834) service to localhost/127.0.0.1:45869 2023-02-18 15:01:38,765 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/cluster_d34029f8-3ba3-200d-fd0b-6049e7b2998e/dfs/data/data3/current/BP-291229437-172.31.14.131-1676732491004] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:38,766 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/cluster_d34029f8-3ba3-200d-fd0b-6049e7b2998e/dfs/data/data4/current/BP-291229437-172.31.14.131-1676732491004] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:38,768 WARN [Listener at localhost/41495] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:38,771 INFO [Listener at localhost/41495] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:38,877 WARN [BP-291229437-172.31.14.131-1676732491004 heartbeating to localhost/127.0.0.1:45869] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:38,878 WARN [BP-291229437-172.31.14.131-1676732491004 heartbeating to localhost/127.0.0.1:45869] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-291229437-172.31.14.131-1676732491004 (Datanode Uuid f6b41277-f197-44f8-980a-e0be79953ff7) service to localhost/127.0.0.1:45869 2023-02-18 15:01:38,879 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/cluster_d34029f8-3ba3-200d-fd0b-6049e7b2998e/dfs/data/data1/current/BP-291229437-172.31.14.131-1676732491004] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:38,880 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/cluster_d34029f8-3ba3-200d-fd0b-6049e7b2998e/dfs/data/data2/current/BP-291229437-172.31.14.131-1676732491004] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:38,890 INFO [Listener at localhost/41495] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:39,010 INFO [Listener at localhost/41495] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 15:01:39,047 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 15:01:39,062 INFO [Listener at localhost/41495] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=228 (was 177) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41495.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/41495.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41495.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/41495.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:45869 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45869 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:45869 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:45869 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/41495.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41495 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41495.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,40113,1676732491599)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41495.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:45869 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41495.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:45869 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41495.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:45869 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41495.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=641 (was 565) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=343 (was 331) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=8659 (was 8709) 2023-02-18 15:01:39,072 INFO [Listener at localhost/41495] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=228, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=343, ProcessCount=171, AvailableMemoryMB=8659 2023-02-18 15:01:39,082 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/hadoop.log.dir so I do NOT create it in target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735 2023-02-18 15:01:39,082 WARN [Listener at localhost/41495] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 15:01:39,083 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/hadoop.tmp.dir so I do NOT create it in target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735 2023-02-18 15:01:39,083 WARN [Listener at localhost/41495] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2e5ad55-bb40-1a96-7624-6e5ebfb7cf3d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 15:01:39,083 DEBUG [Listener at localhost/41495] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735 2023-02-18 15:01:39,083 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 15:01:39,083 INFO [Listener at localhost/41495] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/cluster_e46071a7-bd75-2e14-0534-2183e1204ce4, deleteOnExit=true 2023-02-18 15:01:39,083 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 15:01:39,083 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/test.cache.data in system properties and HBase conf 2023-02-18 15:01:39,083 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 15:01:39,083 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/hadoop.log.dir in system properties and HBase conf 2023-02-18 15:01:39,083 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 15:01:39,083 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 15:01:39,083 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 15:01:39,084 DEBUG [Listener at localhost/41495] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 15:01:39,084 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:39,084 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:39,084 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 15:01:39,084 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:39,084 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 15:01:39,084 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 15:01:39,084 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:39,084 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:39,085 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 15:01:39,085 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/nfs.dump.dir in system properties and HBase conf 2023-02-18 15:01:39,085 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/java.io.tmpdir in system properties and HBase conf 2023-02-18 15:01:39,085 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:39,085 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 15:01:39,085 INFO [Listener at localhost/41495] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 15:01:39,089 WARN [Listener at localhost/41495] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:39,089 WARN [Listener at localhost/41495] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:39,160 WARN [Listener at localhost/41495] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:39,163 INFO [Listener at localhost/41495] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:39,169 INFO [Listener at localhost/41495] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/java.io.tmpdir/Jetty_localhost_40111_hdfs____.ib0g8x/webapp 2023-02-18 15:01:39,272 INFO [Listener at localhost/41495] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40111 2023-02-18 15:01:39,277 WARN [Listener at localhost/41495] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:39,277 WARN [Listener at localhost/41495] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:39,316 WARN [Listener at localhost/34073] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:39,327 WARN [Listener at localhost/34073] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:39,329 WARN [Listener at localhost/34073] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:39,330 INFO [Listener at localhost/34073] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:39,335 INFO [Listener at localhost/34073] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/java.io.tmpdir/Jetty_localhost_41885_datanode____.t23d6p/webapp 2023-02-18 15:01:39,427 INFO [Listener at localhost/34073] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41885 2023-02-18 15:01:39,439 WARN [Listener at localhost/44917] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:39,460 WARN [Listener at localhost/44917] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:39,463 WARN [Listener at localhost/44917] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:39,464 INFO [Listener at localhost/44917] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:39,468 INFO [Listener at localhost/44917] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/java.io.tmpdir/Jetty_localhost_34047_datanode____vmwujd/webapp 2023-02-18 15:01:39,538 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ab512c28a0ea154: Processing first storage report for DS-16c47513-8e84-409d-ad26-cf47f5a38091 from datanode 3f1a512a-d5d3-4d31-bb40-94e25d54bc4e 2023-02-18 15:01:39,538 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ab512c28a0ea154: from storage DS-16c47513-8e84-409d-ad26-cf47f5a38091 node DatanodeRegistration(127.0.0.1:34571, datanodeUuid=3f1a512a-d5d3-4d31-bb40-94e25d54bc4e, infoPort=33953, infoSecurePort=0, ipcPort=44917, storageInfo=lv=-57;cid=testClusterID;nsid=1611944790;c=1676732499091), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:39,538 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ab512c28a0ea154: Processing first storage report for DS-b0f1c554-c00c-4075-bfeb-c88a8e7ceb53 from datanode 3f1a512a-d5d3-4d31-bb40-94e25d54bc4e 2023-02-18 15:01:39,538 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ab512c28a0ea154: from storage DS-b0f1c554-c00c-4075-bfeb-c88a8e7ceb53 node DatanodeRegistration(127.0.0.1:34571, datanodeUuid=3f1a512a-d5d3-4d31-bb40-94e25d54bc4e, infoPort=33953, infoSecurePort=0, ipcPort=44917, storageInfo=lv=-57;cid=testClusterID;nsid=1611944790;c=1676732499091), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:39,568 INFO [Listener at localhost/44917] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34047 2023-02-18 15:01:39,574 WARN [Listener at localhost/44797] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:39,694 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x537f3b035a992ff2: Processing first storage report for DS-94f815d7-1f29-47f2-a419-6a6b785b5360 from datanode e0e72535-1da1-44cc-83f7-1a6e93df51e4 2023-02-18 15:01:39,694 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x537f3b035a992ff2: from storage DS-94f815d7-1f29-47f2-a419-6a6b785b5360 node DatanodeRegistration(127.0.0.1:38975, datanodeUuid=e0e72535-1da1-44cc-83f7-1a6e93df51e4, infoPort=41659, infoSecurePort=0, ipcPort=44797, storageInfo=lv=-57;cid=testClusterID;nsid=1611944790;c=1676732499091), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:39,694 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x537f3b035a992ff2: Processing first storage report for DS-e4a2b4e3-ece8-402b-b3e2-97f2dec557d0 from datanode e0e72535-1da1-44cc-83f7-1a6e93df51e4 2023-02-18 15:01:39,694 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x537f3b035a992ff2: from storage DS-e4a2b4e3-ece8-402b-b3e2-97f2dec557d0 node DatanodeRegistration(127.0.0.1:38975, datanodeUuid=e0e72535-1da1-44cc-83f7-1a6e93df51e4, infoPort=41659, infoSecurePort=0, ipcPort=44797, storageInfo=lv=-57;cid=testClusterID;nsid=1611944790;c=1676732499091), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:39,781 DEBUG [Listener at localhost/44797] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735 2023-02-18 15:01:39,783 INFO [Listener at localhost/44797] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/cluster_e46071a7-bd75-2e14-0534-2183e1204ce4/zookeeper_0, clientPort=52932, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/cluster_e46071a7-bd75-2e14-0534-2183e1204ce4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/cluster_e46071a7-bd75-2e14-0534-2183e1204ce4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 15:01:39,784 INFO [Listener at localhost/44797] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52932 2023-02-18 15:01:39,784 INFO [Listener at localhost/44797] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:39,785 INFO [Listener at localhost/44797] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:39,796 INFO [Listener at localhost/44797] util.FSUtils(479): Created version file at hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3 with version=8 2023-02-18 15:01:39,796 INFO [Listener at localhost/44797] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:39,797 INFO [Listener at localhost/44797] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:39,798 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34073/user/jenkins/test-data/762b8a41-76e7-0236-8083-55d161d180dd/hbase-staging 2023-02-18 15:01:39,801 INFO [Listener at localhost/44797] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:39,801 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:39,801 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:39,801 INFO [Listener at localhost/44797] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:39,801 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:39,801 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:39,801 INFO [Listener at localhost/44797] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:39,802 INFO [Listener at localhost/44797] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44839 2023-02-18 15:01:39,802 INFO [Listener at localhost/44797] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:39,804 INFO [Listener at localhost/44797] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:39,805 INFO [Listener at localhost/44797] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44839 connecting to ZooKeeper ensemble=127.0.0.1:52932 2023-02-18 15:01:39,815 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:448390x0, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:39,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44839-0x10067f3710b0000 connected 2023-02-18 15:01:39,827 DEBUG [Listener at localhost/44797] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:39,828 DEBUG [Listener at localhost/44797] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:39,828 DEBUG [Listener at localhost/44797] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:39,828 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44839 2023-02-18 15:01:39,829 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44839 2023-02-18 15:01:39,829 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44839 2023-02-18 15:01:39,829 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44839 2023-02-18 15:01:39,829 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44839 2023-02-18 15:01:39,829 INFO [Listener at localhost/44797] master.HMaster(444): hbase.rootdir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3, hbase.cluster.distributed=false 2023-02-18 15:01:39,841 INFO [Listener at localhost/44797] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:39,842 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:39,842 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:39,842 INFO [Listener at localhost/44797] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:39,842 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:39,842 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:39,842 INFO [Listener at localhost/44797] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:39,843 INFO [Listener at localhost/44797] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43565 2023-02-18 15:01:39,843 INFO [Listener at localhost/44797] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:39,845 DEBUG [Listener at localhost/44797] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:39,845 INFO [Listener at localhost/44797] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:39,846 INFO [Listener at localhost/44797] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:39,847 INFO [Listener at localhost/44797] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43565 connecting to ZooKeeper ensemble=127.0.0.1:52932 2023-02-18 15:01:39,850 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:435650x0, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:39,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43565-0x10067f3710b0001 connected 2023-02-18 15:01:39,852 DEBUG [Listener at localhost/44797] zookeeper.ZKUtil(164): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:39,852 DEBUG [Listener at localhost/44797] zookeeper.ZKUtil(164): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:39,853 DEBUG [Listener at localhost/44797] zookeeper.ZKUtil(164): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:39,853 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43565 2023-02-18 15:01:39,853 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43565 2023-02-18 15:01:39,853 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43565 2023-02-18 15:01:39,854 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43565 2023-02-18 15:01:39,854 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43565 2023-02-18 15:01:39,865 INFO [Listener at localhost/44797] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:39,865 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:39,865 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:39,865 INFO [Listener at localhost/44797] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:39,865 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:39,865 INFO [Listener at localhost/44797] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:39,865 INFO [Listener at localhost/44797] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:39,866 INFO [Listener at localhost/44797] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39373 2023-02-18 15:01:39,866 INFO [Listener at localhost/44797] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:39,867 DEBUG [Listener at localhost/44797] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:39,867 INFO [Listener at localhost/44797] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:39,868 INFO [Listener at localhost/44797] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:39,869 INFO [Listener at localhost/44797] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39373 connecting to ZooKeeper ensemble=127.0.0.1:52932 2023-02-18 15:01:39,872 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:393730x0, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:39,873 DEBUG [Listener at localhost/44797] zookeeper.ZKUtil(164): regionserver:393730x0, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:39,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39373-0x10067f3710b0002 connected 2023-02-18 15:01:39,874 DEBUG [Listener at localhost/44797] zookeeper.ZKUtil(164): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:39,875 DEBUG [Listener at localhost/44797] zookeeper.ZKUtil(164): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:39,875 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39373 2023-02-18 15:01:39,875 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39373 2023-02-18 15:01:39,877 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39373 2023-02-18 15:01:39,877 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39373 2023-02-18 15:01:39,877 DEBUG [Listener at localhost/44797] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39373 2023-02-18 15:01:39,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44839,1676732499800 2023-02-18 15:01:39,880 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:39,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44839,1676732499800 2023-02-18 15:01:39,882 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:39,882 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:39,883 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:39,882 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:39,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:39,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44839,1676732499800 from backup master directory 2023-02-18 15:01:39,893 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44839,1676732499800 2023-02-18 15:01:39,894 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:39,894 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:39,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44839,1676732499800 2023-02-18 15:01:39,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:39,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/hbase.id with ID: 3aec0178-fbe2-4c48-b7ab-5888b02971db 2023-02-18 15:01:39,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:39,917 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:39,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x615d3a93 to 127.0.0.1:52932 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:39,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bf2c63e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:39,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:39,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 15:01:39,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:39,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/data/master/store-tmp 2023-02-18 15:01:39,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:39,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:39,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:39,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:39,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:39,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:39,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:39,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:39,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/WALs/jenkins-hbase4.apache.org,44839,1676732499800 2023-02-18 15:01:39,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44839%2C1676732499800, suffix=, logDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/WALs/jenkins-hbase4.apache.org,44839,1676732499800, archiveDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/oldWALs, maxLogs=10 2023-02-18 15:01:39,949 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38975,DS-94f815d7-1f29-47f2-a419-6a6b785b5360,DISK] 2023-02-18 15:01:39,949 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34571,DS-16c47513-8e84-409d-ad26-cf47f5a38091,DISK] 2023-02-18 15:01:39,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/WALs/jenkins-hbase4.apache.org,44839,1676732499800/jenkins-hbase4.apache.org%2C44839%2C1676732499800.1676732499937 2023-02-18 15:01:39,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38975,DS-94f815d7-1f29-47f2-a419-6a6b785b5360,DISK], DatanodeInfoWithStorage[127.0.0.1:34571,DS-16c47513-8e84-409d-ad26-cf47f5a38091,DISK]] 2023-02-18 15:01:39,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:39,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:39,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:39,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:39,952 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:39,953 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 15:01:39,953 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 15:01:39,953 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:39,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:39,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:39,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:39,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:39,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67768771, jitterRate=0.009833380579948425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:39,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:39,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 15:01:39,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 15:01:39,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 15:01:39,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 15:01:39,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 15:01:39,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 15:01:39,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 15:01:39,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 15:01:39,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 15:01:39,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 15:01:39,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 15:01:39,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 15:01:39,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 15:01:39,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 15:01:39,972 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:39,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 15:01:39,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 15:01:39,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 15:01:39,975 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:39,975 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:39,975 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:39,975 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:39,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44839,1676732499800, sessionid=0x10067f3710b0000, setting cluster-up flag (Was=false) 2023-02-18 15:01:39,980 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:39,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 15:01:39,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44839,1676732499800 2023-02-18 15:01:39,987 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:39,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 15:01:39,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44839,1676732499800 2023-02-18 15:01:39,992 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.hbase-snapshot/.tmp 2023-02-18 15:01:39,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:39,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:39,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:39,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:39,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:39,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 15:01:39,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:39,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:39,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:39,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676732529996 2023-02-18 15:01:39,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 15:01:39,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 15:01:39,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 15:01:39,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 15:01:39,996 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:39,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 15:01:39,996 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 15:01:39,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 15:01:39,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:39,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 15:01:39,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 15:01:39,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 15:01:39,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 15:01:39,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 15:01:39,997 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:39,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732499997,5,FailOnTimeoutGroup] 2023-02-18 15:01:39,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732499998,5,FailOnTimeoutGroup] 2023-02-18 15:01:39,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:39,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 15:01:39,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:39,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,004 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:40,005 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:40,005 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3 2023-02-18 15:01:40,010 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:40,011 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:40,012 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/info 2023-02-18 15:01:40,012 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:40,013 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:40,013 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:40,014 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:40,014 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:40,014 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:40,014 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:40,015 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/table 2023-02-18 15:01:40,015 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:40,016 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:40,016 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740 2023-02-18 15:01:40,016 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740 2023-02-18 15:01:40,018 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:40,019 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:40,020 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:40,020 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67936787, jitterRate=0.012337014079093933}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:40,020 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:40,020 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:40,020 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:40,021 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:40,021 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:40,021 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:40,021 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:40,021 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:40,021 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:40,021 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 15:01:40,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 15:01:40,023 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 15:01:40,024 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 15:01:40,080 INFO [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(952): ClusterId : 3aec0178-fbe2-4c48-b7ab-5888b02971db 2023-02-18 15:01:40,080 INFO [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer(952): ClusterId : 3aec0178-fbe2-4c48-b7ab-5888b02971db 2023-02-18 15:01:40,080 DEBUG [RS:0;jenkins-hbase4:43565] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:40,080 DEBUG [RS:1;jenkins-hbase4:39373] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:40,084 DEBUG [RS:0;jenkins-hbase4:43565] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:40,084 DEBUG [RS:0;jenkins-hbase4:43565] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:40,084 DEBUG [RS:1;jenkins-hbase4:39373] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:40,084 DEBUG [RS:1;jenkins-hbase4:39373] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:40,086 DEBUG [RS:0;jenkins-hbase4:43565] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:40,088 DEBUG [RS:0;jenkins-hbase4:43565] zookeeper.ReadOnlyZKClient(139): Connect 0x1869eb19 to 127.0.0.1:52932 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:40,088 DEBUG [RS:1;jenkins-hbase4:39373] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:40,089 DEBUG [RS:1;jenkins-hbase4:39373] zookeeper.ReadOnlyZKClient(139): Connect 0x71c69617 to 127.0.0.1:52932 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:40,100 DEBUG [RS:0;jenkins-hbase4:43565] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16ae0664, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:40,100 DEBUG [RS:1;jenkins-hbase4:39373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f01665f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:40,100 DEBUG [RS:0;jenkins-hbase4:43565] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12918069, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:40,100 DEBUG [RS:1;jenkins-hbase4:39373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b3efd67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:40,109 DEBUG [RS:1;jenkins-hbase4:39373] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39373 2023-02-18 15:01:40,109 INFO [RS:1;jenkins-hbase4:39373] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:40,109 INFO [RS:1;jenkins-hbase4:39373] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:40,110 DEBUG [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:40,110 INFO [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44839,1676732499800 with isa=jenkins-hbase4.apache.org/172.31.14.131:39373, startcode=1676732499864 2023-02-18 15:01:40,110 DEBUG [RS:1;jenkins-hbase4:39373] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:40,112 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58175, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:40,112 DEBUG [RS:0;jenkins-hbase4:43565] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43565 2023-02-18 15:01:40,112 INFO [RS:0;jenkins-hbase4:43565] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:40,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:40,113 INFO [RS:0;jenkins-hbase4:43565] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:40,113 DEBUG [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:40,114 DEBUG [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3 2023-02-18 15:01:40,114 DEBUG [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34073 2023-02-18 15:01:40,114 DEBUG [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:40,114 INFO [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44839,1676732499800 with isa=jenkins-hbase4.apache.org/172.31.14.131:43565, startcode=1676732499841 2023-02-18 15:01:40,114 DEBUG [RS:0;jenkins-hbase4:43565] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:40,115 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47897, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:40,115 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:40,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:40,116 DEBUG [RS:1;jenkins-hbase4:39373] zookeeper.ZKUtil(162): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:40,116 WARN [RS:1;jenkins-hbase4:39373] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:40,116 INFO [RS:1;jenkins-hbase4:39373] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:40,116 DEBUG [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/WALs/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:40,116 DEBUG [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3 2023-02-18 15:01:40,117 DEBUG [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34073 2023-02-18 15:01:40,117 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39373,1676732499864] 2023-02-18 15:01:40,117 DEBUG [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:40,121 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:40,121 DEBUG [RS:0;jenkins-hbase4:43565] zookeeper.ZKUtil(162): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:40,121 WARN [RS:0;jenkins-hbase4:43565] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:40,121 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43565,1676732499841] 2023-02-18 15:01:40,121 INFO [RS:0;jenkins-hbase4:43565] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:40,121 DEBUG [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/WALs/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:40,121 DEBUG [RS:1;jenkins-hbase4:39373] zookeeper.ZKUtil(162): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:40,123 DEBUG [RS:1;jenkins-hbase4:39373] zookeeper.ZKUtil(162): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:40,125 DEBUG [RS:1;jenkins-hbase4:39373] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:40,125 INFO [RS:1;jenkins-hbase4:39373] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:40,126 DEBUG [RS:0;jenkins-hbase4:43565] zookeeper.ZKUtil(162): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:40,126 DEBUG [RS:0;jenkins-hbase4:43565] zookeeper.ZKUtil(162): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:40,126 INFO [RS:1;jenkins-hbase4:39373] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:40,126 INFO [RS:1;jenkins-hbase4:39373] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:40,126 INFO [RS:1;jenkins-hbase4:39373] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,127 DEBUG [RS:0;jenkins-hbase4:43565] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:40,127 INFO [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:40,127 INFO [RS:0;jenkins-hbase4:43565] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:40,128 INFO [RS:1;jenkins-hbase4:39373] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,128 DEBUG [RS:1;jenkins-hbase4:39373] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,128 DEBUG [RS:1;jenkins-hbase4:39373] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,128 DEBUG [RS:1;jenkins-hbase4:39373] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,128 DEBUG [RS:1;jenkins-hbase4:39373] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,128 DEBUG [RS:1;jenkins-hbase4:39373] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,128 DEBUG [RS:1;jenkins-hbase4:39373] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:40,128 DEBUG [RS:1;jenkins-hbase4:39373] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,128 DEBUG [RS:1;jenkins-hbase4:39373] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,128 DEBUG [RS:1;jenkins-hbase4:39373] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,128 DEBUG [RS:1;jenkins-hbase4:39373] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,132 INFO [RS:0;jenkins-hbase4:43565] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:40,132 INFO [RS:1;jenkins-hbase4:39373] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,132 INFO [RS:1;jenkins-hbase4:39373] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,132 INFO [RS:1;jenkins-hbase4:39373] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,132 INFO [RS:0;jenkins-hbase4:43565] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:40,133 INFO [RS:0;jenkins-hbase4:43565] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,133 INFO [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:40,134 INFO [RS:0;jenkins-hbase4:43565] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,134 DEBUG [RS:0;jenkins-hbase4:43565] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,134 DEBUG [RS:0;jenkins-hbase4:43565] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,134 DEBUG [RS:0;jenkins-hbase4:43565] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,134 DEBUG [RS:0;jenkins-hbase4:43565] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,134 DEBUG [RS:0;jenkins-hbase4:43565] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,134 DEBUG [RS:0;jenkins-hbase4:43565] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:40,134 DEBUG [RS:0;jenkins-hbase4:43565] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,134 DEBUG [RS:0;jenkins-hbase4:43565] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,134 DEBUG [RS:0;jenkins-hbase4:43565] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,134 DEBUG [RS:0;jenkins-hbase4:43565] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:40,135 INFO [RS:0;jenkins-hbase4:43565] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,135 INFO [RS:0;jenkins-hbase4:43565] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,136 INFO [RS:0;jenkins-hbase4:43565] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,144 INFO [RS:1;jenkins-hbase4:39373] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:40,145 INFO [RS:1;jenkins-hbase4:39373] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39373,1676732499864-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,146 INFO [RS:0;jenkins-hbase4:43565] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:40,146 INFO [RS:0;jenkins-hbase4:43565] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43565,1676732499841-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,154 INFO [RS:1;jenkins-hbase4:39373] regionserver.Replication(203): jenkins-hbase4.apache.org,39373,1676732499864 started 2023-02-18 15:01:40,155 INFO [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39373,1676732499864, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39373, sessionid=0x10067f3710b0002 2023-02-18 15:01:40,155 DEBUG [RS:1;jenkins-hbase4:39373] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:40,155 DEBUG [RS:1;jenkins-hbase4:39373] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:40,155 DEBUG [RS:1;jenkins-hbase4:39373] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39373,1676732499864' 2023-02-18 15:01:40,155 DEBUG [RS:1;jenkins-hbase4:39373] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:40,155 DEBUG [RS:1;jenkins-hbase4:39373] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:40,155 DEBUG [RS:1;jenkins-hbase4:39373] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:40,155 DEBUG [RS:1;jenkins-hbase4:39373] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:40,155 DEBUG [RS:1;jenkins-hbase4:39373] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:40,155 DEBUG [RS:1;jenkins-hbase4:39373] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39373,1676732499864' 2023-02-18 15:01:40,155 DEBUG [RS:1;jenkins-hbase4:39373] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:40,156 INFO [RS:0;jenkins-hbase4:43565] regionserver.Replication(203): jenkins-hbase4.apache.org,43565,1676732499841 started 2023-02-18 15:01:40,156 DEBUG [RS:1;jenkins-hbase4:39373] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:40,156 INFO [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43565,1676732499841, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43565, sessionid=0x10067f3710b0001 2023-02-18 15:01:40,156 DEBUG [RS:0;jenkins-hbase4:43565] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:40,156 DEBUG [RS:0;jenkins-hbase4:43565] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:40,156 DEBUG [RS:0;jenkins-hbase4:43565] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43565,1676732499841' 2023-02-18 15:01:40,156 DEBUG [RS:0;jenkins-hbase4:43565] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:40,156 DEBUG [RS:1;jenkins-hbase4:39373] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:40,156 INFO [RS:1;jenkins-hbase4:39373] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:40,156 INFO [RS:1;jenkins-hbase4:39373] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:40,156 DEBUG [RS:0;jenkins-hbase4:43565] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:40,156 DEBUG [RS:0;jenkins-hbase4:43565] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:40,156 DEBUG [RS:0;jenkins-hbase4:43565] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:40,156 DEBUG [RS:0;jenkins-hbase4:43565] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:40,156 DEBUG [RS:0;jenkins-hbase4:43565] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43565,1676732499841' 2023-02-18 15:01:40,156 DEBUG [RS:0;jenkins-hbase4:43565] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:40,157 DEBUG [RS:0;jenkins-hbase4:43565] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:40,157 DEBUG [RS:0;jenkins-hbase4:43565] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:40,157 INFO [RS:0;jenkins-hbase4:43565] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:40,157 INFO [RS:0;jenkins-hbase4:43565] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:40,174 DEBUG [jenkins-hbase4:44839] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 15:01:40,174 DEBUG [jenkins-hbase4:44839] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:40,176 DEBUG [jenkins-hbase4:44839] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:40,176 DEBUG [jenkins-hbase4:44839] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:40,176 DEBUG [jenkins-hbase4:44839] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:40,176 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43565,1676732499841, state=OPENING 2023-02-18 15:01:40,179 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 15:01:40,180 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:40,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43565,1676732499841}] 2023-02-18 15:01:40,182 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:40,338 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:40,338 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:40,340 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39148, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:40,344 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 15:01:40,344 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:40,345 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43565%2C1676732499841.meta, suffix=.meta, logDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/WALs/jenkins-hbase4.apache.org,43565,1676732499841, archiveDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/oldWALs, maxLogs=32 2023-02-18 15:01:40,359 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38975,DS-94f815d7-1f29-47f2-a419-6a6b785b5360,DISK] 2023-02-18 15:01:40,359 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34571,DS-16c47513-8e84-409d-ad26-cf47f5a38091,DISK] 2023-02-18 15:01:40,362 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/WALs/jenkins-hbase4.apache.org,43565,1676732499841/jenkins-hbase4.apache.org%2C43565%2C1676732499841.meta.1676732500345.meta 2023-02-18 15:01:40,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34571,DS-16c47513-8e84-409d-ad26-cf47f5a38091,DISK], DatanodeInfoWithStorage[127.0.0.1:38975,DS-94f815d7-1f29-47f2-a419-6a6b785b5360,DISK]] 2023-02-18 15:01:40,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:40,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 15:01:40,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 15:01:40,363 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 15:01:40,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 15:01:40,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:40,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 15:01:40,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 15:01:40,365 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:40,366 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/info 2023-02-18 15:01:40,366 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/info 2023-02-18 15:01:40,366 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:40,366 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:40,367 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:40,368 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:40,368 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:40,368 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:40,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:40,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:40,370 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/table 2023-02-18 15:01:40,370 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/table 2023-02-18 15:01:40,370 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:40,371 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:40,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740 2023-02-18 15:01:40,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740 2023-02-18 15:01:40,375 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:40,376 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:40,377 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61451015, jitterRate=-0.08430851995944977}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:40,377 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:40,378 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676732500338 2023-02-18 15:01:40,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 15:01:40,382 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 15:01:40,384 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43565,1676732499841, state=OPEN 2023-02-18 15:01:40,385 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 15:01:40,385 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:40,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 15:01:40,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43565,1676732499841 in 205 msec 2023-02-18 15:01:40,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 15:01:40,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-18 15:01:40,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 396 msec 2023-02-18 15:01:40,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676732500390, completionTime=-1 2023-02-18 15:01:40,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 15:01:40,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 15:01:40,393 DEBUG [hconnection-0xba7412c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:40,394 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39158, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:40,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 15:01:40,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676732560396 2023-02-18 15:01:40,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676732620396 2023-02-18 15:01:40,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-18 15:01:40,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44839,1676732499800-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44839,1676732499800-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44839,1676732499800-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44839, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:40,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 15:01:40,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:40,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 15:01:40,406 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 15:01:40,406 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:40,407 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:40,408 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9 2023-02-18 15:01:40,409 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9 empty. 2023-02-18 15:01:40,409 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9 2023-02-18 15:01:40,409 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 15:01:40,419 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:40,421 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4c1257b543c57f4cbb126dbb76313bc9, NAME => 'hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp 2023-02-18 15:01:40,433 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:40,434 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4c1257b543c57f4cbb126dbb76313bc9, disabling compactions & flushes 2023-02-18 15:01:40,434 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:40,434 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:40,434 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. after waiting 0 ms 2023-02-18 15:01:40,434 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:40,434 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:40,434 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4c1257b543c57f4cbb126dbb76313bc9: 2023-02-18 15:01:40,436 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:40,437 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732500436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732500436"}]},"ts":"1676732500436"} 2023-02-18 15:01:40,439 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 15:01:40,440 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:40,440 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732500440"}]},"ts":"1676732500440"} 2023-02-18 15:01:40,441 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 15:01:40,445 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:40,446 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:40,446 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:40,446 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:40,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4c1257b543c57f4cbb126dbb76313bc9, ASSIGN}] 2023-02-18 15:01:40,448 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4c1257b543c57f4cbb126dbb76313bc9, ASSIGN 2023-02-18 15:01:40,449 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4c1257b543c57f4cbb126dbb76313bc9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43565,1676732499841; forceNewPlan=false, retain=false 2023-02-18 15:01:40,599 INFO [jenkins-hbase4:44839] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 15:01:40,600 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4c1257b543c57f4cbb126dbb76313bc9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:40,600 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732500600"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732500600"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732500600"}]},"ts":"1676732500600"} 2023-02-18 15:01:40,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4c1257b543c57f4cbb126dbb76313bc9, server=jenkins-hbase4.apache.org,43565,1676732499841}] 2023-02-18 15:01:40,756 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:40,757 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43565%2C1676732499841, suffix=, logDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/WALs/jenkins-hbase4.apache.org,43565,1676732499841, archiveDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/oldWALs, maxLogs=32 2023-02-18 15:01:40,769 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34571,DS-16c47513-8e84-409d-ad26-cf47f5a38091,DISK] 2023-02-18 15:01:40,769 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38975,DS-94f815d7-1f29-47f2-a419-6a6b785b5360,DISK] 2023-02-18 15:01:40,771 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/WALs/jenkins-hbase4.apache.org,43565,1676732499841/jenkins-hbase4.apache.org%2C43565%2C1676732499841.1676732500757 2023-02-18 15:01:40,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34571,DS-16c47513-8e84-409d-ad26-cf47f5a38091,DISK], DatanodeInfoWithStorage[127.0.0.1:38975,DS-94f815d7-1f29-47f2-a419-6a6b785b5360,DISK]] 2023-02-18 15:01:40,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4c1257b543c57f4cbb126dbb76313bc9, NAME => 'hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:40,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4c1257b543c57f4cbb126dbb76313bc9 2023-02-18 15:01:40,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:40,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4c1257b543c57f4cbb126dbb76313bc9 2023-02-18 15:01:40,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4c1257b543c57f4cbb126dbb76313bc9 2023-02-18 15:01:40,779 INFO [StoreOpener-4c1257b543c57f4cbb126dbb76313bc9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4c1257b543c57f4cbb126dbb76313bc9 2023-02-18 15:01:40,780 DEBUG [StoreOpener-4c1257b543c57f4cbb126dbb76313bc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9/info 2023-02-18 15:01:40,780 DEBUG [StoreOpener-4c1257b543c57f4cbb126dbb76313bc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9/info 2023-02-18 15:01:40,780 INFO [StoreOpener-4c1257b543c57f4cbb126dbb76313bc9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c1257b543c57f4cbb126dbb76313bc9 columnFamilyName info 2023-02-18 15:01:40,780 INFO [StoreOpener-4c1257b543c57f4cbb126dbb76313bc9-1] regionserver.HStore(310): Store=4c1257b543c57f4cbb126dbb76313bc9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:40,781 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9 2023-02-18 15:01:40,781 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9 2023-02-18 15:01:40,783 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4c1257b543c57f4cbb126dbb76313bc9 2023-02-18 15:01:40,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:40,784 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4c1257b543c57f4cbb126dbb76313bc9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67129011, jitterRate=3.0021369457244873E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:40,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4c1257b543c57f4cbb126dbb76313bc9: 2023-02-18 15:01:40,785 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9., pid=6, masterSystemTime=1676732500753 2023-02-18 15:01:40,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:40,787 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:40,787 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4c1257b543c57f4cbb126dbb76313bc9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:40,787 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732500787"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732500787"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732500787"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732500787"}]},"ts":"1676732500787"} 2023-02-18 15:01:40,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 15:01:40,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4c1257b543c57f4cbb126dbb76313bc9, server=jenkins-hbase4.apache.org,43565,1676732499841 in 188 msec 2023-02-18 15:01:40,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 15:01:40,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4c1257b543c57f4cbb126dbb76313bc9, ASSIGN in 344 msec 2023-02-18 15:01:40,793 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:40,794 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732500793"}]},"ts":"1676732500793"} 2023-02-18 15:01:40,795 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 15:01:40,797 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:40,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 393 msec 2023-02-18 15:01:40,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 15:01:40,809 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:40,809 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:40,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 15:01:40,818 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:40,820 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-18 15:01:40,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 15:01:40,827 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:40,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-18 15:01:40,836 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 15:01:40,839 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 15:01:40,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.944sec 2023-02-18 15:01:40,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 15:01:40,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 15:01:40,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 15:01:40,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44839,1676732499800-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 15:01:40,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44839,1676732499800-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 15:01:40,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 15:01:40,880 DEBUG [Listener at localhost/44797] zookeeper.ReadOnlyZKClient(139): Connect 0x7aa7551c to 127.0.0.1:52932 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:40,887 DEBUG [Listener at localhost/44797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f6e77df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:40,889 DEBUG [hconnection-0x4549b91b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:40,890 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39172, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:40,892 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44839,1676732499800 2023-02-18 15:01:40,892 DEBUG [Listener at localhost/44797] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 15:01:40,893 DEBUG [Listener at localhost/44797] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 15:01:40,895 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53016, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 15:01:40,895 INFO [Listener at localhost/44797] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-18 15:01:40,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-18 15:01:40,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 15:01:40,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:53016 deadline: 1676732560896, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-18 15:01:40,896 INFO [Listener at localhost/44797] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-18 15:01:40,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:40,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:40,901 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:40,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-18 15:01:40,902 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:40,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:40,903 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:40,903 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a empty. 2023-02-18 15:01:40,904 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:40,904 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-18 15:01:40,913 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:40,914 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => d56dddf5ec60b85220f3cc55e40fcd2a, NAME => 'testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp 2023-02-18 15:01:40,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:40,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing d56dddf5ec60b85220f3cc55e40fcd2a, disabling compactions & flushes 2023-02-18 15:01:40,921 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:40,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:40,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. after waiting 0 ms 2023-02-18 15:01:40,922 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:40,922 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:40,922 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for d56dddf5ec60b85220f3cc55e40fcd2a: 2023-02-18 15:01:40,924 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:40,925 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676732500925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732500925"}]},"ts":"1676732500925"} 2023-02-18 15:01:40,926 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 15:01:40,927 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:40,927 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732500927"}]},"ts":"1676732500927"} 2023-02-18 15:01:40,929 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-18 15:01:40,932 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:40,933 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:40,933 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:40,933 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:40,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d56dddf5ec60b85220f3cc55e40fcd2a, ASSIGN}] 2023-02-18 15:01:40,936 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d56dddf5ec60b85220f3cc55e40fcd2a, ASSIGN 2023-02-18 15:01:40,936 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d56dddf5ec60b85220f3cc55e40fcd2a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39373,1676732499864; forceNewPlan=false, retain=false 2023-02-18 15:01:41,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:41,087 INFO [jenkins-hbase4:44839] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 15:01:41,087 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d56dddf5ec60b85220f3cc55e40fcd2a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,087 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676732501087"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732501087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732501087"}]},"ts":"1676732501087"} 2023-02-18 15:01:41,089 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure d56dddf5ec60b85220f3cc55e40fcd2a, server=jenkins-hbase4.apache.org,39373,1676732499864}] 2023-02-18 15:01:41,158 INFO [RS:1;jenkins-hbase4:39373] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39373%2C1676732499864, suffix=, logDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/WALs/jenkins-hbase4.apache.org,39373,1676732499864, archiveDir=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/oldWALs, maxLogs=32 2023-02-18 15:01:41,180 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38975,DS-94f815d7-1f29-47f2-a419-6a6b785b5360,DISK] 2023-02-18 15:01:41,180 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34571,DS-16c47513-8e84-409d-ad26-cf47f5a38091,DISK] 2023-02-18 15:01:41,185 INFO [RS:1;jenkins-hbase4:39373] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/WALs/jenkins-hbase4.apache.org,39373,1676732499864/jenkins-hbase4.apache.org%2C39373%2C1676732499864.1676732501158 2023-02-18 15:01:41,185 DEBUG [RS:1;jenkins-hbase4:39373] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38975,DS-94f815d7-1f29-47f2-a419-6a6b785b5360,DISK], DatanodeInfoWithStorage[127.0.0.1:34571,DS-16c47513-8e84-409d-ad26-cf47f5a38091,DISK]] 2023-02-18 15:01:41,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:41,241 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,241 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:41,243 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56240, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:41,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:41,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d56dddf5ec60b85220f3cc55e40fcd2a, NAME => 'testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:41,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:41,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:41,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:41,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:41,247 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:41,248 DEBUG [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1 2023-02-18 15:01:41,248 DEBUG [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1 2023-02-18 15:01:41,248 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d56dddf5ec60b85220f3cc55e40fcd2a columnFamilyName f1 2023-02-18 15:01:41,249 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] regionserver.HStore(310): Store=d56dddf5ec60b85220f3cc55e40fcd2a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:41,249 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:41,250 DEBUG [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2 2023-02-18 15:01:41,250 DEBUG [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2 2023-02-18 15:01:41,250 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d56dddf5ec60b85220f3cc55e40fcd2a columnFamilyName f2 2023-02-18 15:01:41,250 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] regionserver.HStore(310): Store=d56dddf5ec60b85220f3cc55e40fcd2a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:41,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:41,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:41,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:41,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:41,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:41,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d56dddf5ec60b85220f3cc55e40fcd2a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58943601, jitterRate=-0.1216719001531601}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:41,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d56dddf5ec60b85220f3cc55e40fcd2a: 2023-02-18 15:01:41,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a., pid=12, masterSystemTime=1676732501241 2023-02-18 15:01:41,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:41,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:41,261 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d56dddf5ec60b85220f3cc55e40fcd2a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,261 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676732501261"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732501261"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732501261"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732501261"}]},"ts":"1676732501261"} 2023-02-18 15:01:41,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 15:01:41,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure d56dddf5ec60b85220f3cc55e40fcd2a, server=jenkins-hbase4.apache.org,39373,1676732499864 in 174 msec 2023-02-18 15:01:41,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 15:01:41,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d56dddf5ec60b85220f3cc55e40fcd2a, ASSIGN in 331 msec 2023-02-18 15:01:41,266 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:41,266 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732501266"}]},"ts":"1676732501266"} 2023-02-18 15:01:41,267 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-18 15:01:41,269 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:41,270 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 370 msec 2023-02-18 15:01:41,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:41,509 INFO [Listener at localhost/44797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-18 15:01:41,509 DEBUG [Listener at localhost/44797] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-18 15:01:41,509 INFO [Listener at localhost/44797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:41,512 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-18 15:01:41,512 INFO [Listener at localhost/44797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:41,512 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-18 15:01:41,512 INFO [Listener at localhost/44797] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 15:01:41,532 DEBUG [hconnection-0x4549b91b-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:41,566 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56244, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:41,577 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39373] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:41,877 INFO [Listener at localhost/44797] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 15:01:41,878 INFO [Listener at localhost/44797] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 15:01:41,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-18 15:01:41,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676732501879 (current time:1676732501879). 2023-02-18 15:01:41,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 15:01:41,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] zookeeper.ReadOnlyZKClient(139): Connect 0x2c600017 to 127.0.0.1:52932 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:41,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ae754b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:41,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:41,884 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39188, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:41,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c600017 to 127.0.0.1:52932 2023-02-18 15:01:41,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:41,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 15:01:41,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-18 15:01:41,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-18 15:01:41,888 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-18 15:01:41,889 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676733101889 2023-02-18 15:01:41,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-18 15:01:41,889 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,890 DEBUG [Listener at localhost/44797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:41,890 DEBUG [Listener at localhost/44797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 15:01:41,891 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-18 15:01:41,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-18 15:01:41,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-18 15:01:41,892 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-18 15:01:41,893 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676733101893 2023-02-18 15:01:41,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,902 INFO [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-18 15:01:41,902 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:41,903 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-18 15:01:41,903 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-18 15:01:41,903 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,903 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,904 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:41,905 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:41,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:41,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:41,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:41,905 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:41,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,905 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,905 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:41,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-18 15:01:41,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-18 15:01:41,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,906 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-18 15:01:41,906 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-18 15:01:41,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,906 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-18 15:01:41,906 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:41,906 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-18 15:01:41,906 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 15:01:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 15:01:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 15:01:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 15:01:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39373,1676732499864' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 15:01:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43565,1676732499841' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 15:01:41,910 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,910 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,910 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:41,910 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,910 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:41,910 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,910 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:41,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:41,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:41,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39373,1676732499864' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-18 15:01:41,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d1aba6c[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:41,911 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-18 15:01:41,911 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,913 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,913 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 15:01:41,913 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,913 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 15:01:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 15:01:41,913 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 15:01:41,913 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. started... 2023-02-18 15:01:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,43565,1676732499841' in zk 2023-02-18 15:01:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 15:01:41,913 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d56dddf5ec60b85220f3cc55e40fcd2a 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 15:01:41,915 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 15:01:41,915 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:41,915 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 15:01:41,926 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/.tmp/f1/3016470fb4d44ab6b44b46b0a8025f23 2023-02-18 15:01:41,942 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/.tmp/f2/90f4030c10e245eda17576645e40500c 2023-02-18 15:01:41,946 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/.tmp/f1/3016470fb4d44ab6b44b46b0a8025f23 as hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1/3016470fb4d44ab6b44b46b0a8025f23 2023-02-18 15:01:41,950 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1/3016470fb4d44ab6b44b46b0a8025f23, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 15:01:41,950 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/.tmp/f2/90f4030c10e245eda17576645e40500c as hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2/90f4030c10e245eda17576645e40500c 2023-02-18 15:01:41,954 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2/90f4030c10e245eda17576645e40500c, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 15:01:41,955 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for d56dddf5ec60b85220f3cc55e40fcd2a in 42ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:41,955 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-18 15:01:41,955 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d56dddf5ec60b85220f3cc55e40fcd2a: 2023-02-18 15:01:41,955 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,956 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:41,956 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1/3016470fb4d44ab6b44b46b0a8025f23] hfiles 2023-02-18 15:01:41,956 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1/3016470fb4d44ab6b44b46b0a8025f23 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,956 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2/90f4030c10e245eda17576645e40500c] hfiles 2023-02-18 15:01:41,956 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2/90f4030c10e245eda17576645e40500c for snapshot=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,962 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. completed. 2023-02-18 15:01:41,962 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:41,962 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 15:01:41,962 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 15:01:41,962 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,962 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 15:01:41,962 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,39373,1676732499864' in zk 2023-02-18 15:01:41,963 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 15:01:41,963 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,963 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:41,963 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 15:01:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,39373,1676732499864': 2023-02-18 15:01:41,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39373,1676732499864' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-18 15:01:41,966 INFO [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-18 15:01:41,966 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:41,966 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:41,966 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,966 INFO [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 15:01:41,969 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,969 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:41,969 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:41,969 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,969 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:41,969 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:41,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:41,970 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,971 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:41,971 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,976 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,976 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:41,976 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:41,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:41,977 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:41,977 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:41,976 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,977 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:41,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:41,977 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:41,977 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:41,977 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,977 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:41,977 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:41,977 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:41,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:41,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,977 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,977 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:41,991 DEBUG [Listener at localhost/44797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:41,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-18 15:01:41,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:41,992 DEBUG [Listener at localhost/44797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 15:01:42,003 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-18 15:01:42,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,003 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676732501889Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676732501977 (+88 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676732501977Writing data manifest for testWithMockedMapReduceSingleRegion at 1676732501979 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676732501984 (+5 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676732502003 (+19 ms) 2023-02-18 15:01:42,005 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-18 15:01:42,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 115 msec 2023-02-18 15:01:42,192 DEBUG [Listener at localhost/44797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:42,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-18 15:01:42,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 15:01:42,194 INFO [Listener at localhost/44797] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 15:01:42,197 INFO [Listener at localhost/44797] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 15:01:42,201 INFO [Listener at localhost/44797] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 15:01:42,228 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39373] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,362 INFO [Listener at localhost/44797] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 15:01:42,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 15:01:42,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,369 INFO [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-18 15:01:42,369 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:42,370 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-18 15:01:42,370 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-18 15:01:42,370 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,370 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,371 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:42,371 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:42,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:42,371 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:42,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:42,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:42,372 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,372 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:42,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:42,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,373 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:42,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,373 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,373 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-18 15:01:42,373 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:42,373 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-18 15:01:42,374 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 15:01:42,374 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 15:01:42,374 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:42,374 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43565,1676732499841' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 15:01:42,375 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 15:01:42,375 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 15:01:42,375 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 15:01:42,375 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,375 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. started... 2023-02-18 15:01:42,375 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d56dddf5ec60b85220f3cc55e40fcd2a 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 15:01:42,377 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,377 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,377 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:42,391 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/.tmp/f1/baaf25f62d914146985641e4c7c614bd 2023-02-18 15:01:42,411 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/.tmp/f2/817416fbf74d4ff3aa00565f7cd91ea6 2023-02-18 15:01:42,415 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/.tmp/f1/baaf25f62d914146985641e4c7c614bd as hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1/baaf25f62d914146985641e4c7c614bd 2023-02-18 15:01:42,419 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1/baaf25f62d914146985641e4c7c614bd, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 15:01:42,420 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/.tmp/f2/817416fbf74d4ff3aa00565f7cd91ea6 as hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2/817416fbf74d4ff3aa00565f7cd91ea6 2023-02-18 15:01:42,423 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2/817416fbf74d4ff3aa00565f7cd91ea6, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 15:01:42,424 INFO [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for d56dddf5ec60b85220f3cc55e40fcd2a in 49ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:42,425 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d56dddf5ec60b85220f3cc55e40fcd2a: 2023-02-18 15:01:42,425 DEBUG [rs(jenkins-hbase4.apache.org,39373,1676732499864)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,425 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 15:01:42,425 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 15:01:42,425 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,425 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 15:01:42,425 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39373,1676732499864' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 15:01:42,427 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,427 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:42,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:42,428 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,428 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:42,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:42,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:42,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:42,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:42,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39373,1676732499864' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-18 15:01:42,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69253317[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:42,429 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-18 15:01:42,429 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,430 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,430 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,430 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 15:01:42,430 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,431 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:42,430 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 15:01:42,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,431 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,43565,1676732499841' in zk 2023-02-18 15:01:42,431 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 15:01:42,431 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 15:01:42,431 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,39373,1676732499864' in zk 2023-02-18 15:01:42,432 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 15:01:42,432 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:42,432 DEBUG [member: 'jenkins-hbase4.apache.org,43565,1676732499841' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 15:01:42,433 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 15:01:42,433 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,433 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:42,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,433 DEBUG [member: 'jenkins-hbase4.apache.org,39373,1676732499864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 15:01:42,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:42,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:42,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:42,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:42,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:42,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:42,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:42,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,39373,1676732499864': 2023-02-18 15:01:42,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39373,1676732499864' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-18 15:01:42,436 INFO [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-18 15:01:42,436 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:42,436 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:42,436 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,436 INFO [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 15:01:42,438 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,438 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,438 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:42,438 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:42,438 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:42,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:42,439 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:42,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,439 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,441 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:42,441 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,443 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,443 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,443 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:42,443 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:42,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:42,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-18 15:01:42,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 15:01:42,443 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:42,444 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:42,443 DEBUG [(jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:42,443 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,443 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:42,444 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:42,444 DEBUG [Listener at localhost/44797] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:42,444 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:42,444 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:42,444 DEBUG [Listener at localhost/44797] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 15:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:42,444 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,444 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:42,544 DEBUG [Listener at localhost/44797] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 15:01:42,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 15:01:42,549 INFO [Listener at localhost/44797] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676732501879 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:42,549 DEBUG [Listener at localhost/44797] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34073/user/jenkins/test-data/762b8a41-76e7-0236-8083-55d161d180dd/testWithMockedMapReduceSingleRegion/8fd79756-fd6d-4541-bae0-bb19675af578/data/default/testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,550 INFO [Listener at localhost/44797] snapshot.RestoreSnapshotHelper(239): region to add: d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:42,550 INFO [Listener at localhost/44797] snapshot.RestoreSnapshotHelper(585): clone region=d56dddf5ec60b85220f3cc55e40fcd2a as d56dddf5ec60b85220f3cc55e40fcd2a in snapshot testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,550 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d56dddf5ec60b85220f3cc55e40fcd2a, NAME => 'testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34073/user/jenkins/test-data/762b8a41-76e7-0236-8083-55d161d180dd/testWithMockedMapReduceSingleRegion/8fd79756-fd6d-4541-bae0-bb19675af578 2023-02-18 15:01:42,556 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:42,556 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3016470fb4d44ab6b44b46b0a8025f23 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,558 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 90f4030c10e245eda17576645e40500c from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,559 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d56dddf5ec60b85220f3cc55e40fcd2a, disabling compactions & flushes 2023-02-18 15:01:42,559 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,559 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,559 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. after waiting 0 ms 2023-02-18 15:01:42,559 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,559 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,559 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d56dddf5ec60b85220f3cc55e40fcd2a: 2023-02-18 15:01:42,560 INFO [Listener at localhost/44797] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676732501879 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:42,560 DEBUG [Listener at localhost/44797] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34073/user/jenkins/test-data/762b8a41-76e7-0236-8083-55d161d180dd/testWithMockedMapReduceSingleRegion/8fd79756-fd6d-4541-bae0-bb19675af578 2023-02-18 15:01:42,560 DEBUG [Listener at localhost/44797] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34073/user/jenkins/test-data/762b8a41-76e7-0236-8083-55d161d180dd/testWithMockedMapReduceSingleRegion/8fd79756-fd6d-4541-bae0-bb19675af578 2023-02-18 15:01:42,560 DEBUG [Listener at localhost/44797] util.CommonFSUtils(699): |-data/ 2023-02-18 15:01:42,560 DEBUG [Listener at localhost/44797] util.CommonFSUtils(699): |----default/ 2023-02-18 15:01:42,561 DEBUG [Listener at localhost/44797] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-18 15:01:42,561 DEBUG [Listener at localhost/44797] util.CommonFSUtils(699): |----------d56dddf5ec60b85220f3cc55e40fcd2a/ 2023-02-18 15:01:42,561 DEBUG [Listener at localhost/44797] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:42,561 DEBUG [Listener at localhost/44797] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:42,561 DEBUG [Listener at localhost/44797] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=d56dddf5ec60b85220f3cc55e40fcd2a-3016470fb4d44ab6b44b46b0a8025f23 2023-02-18 15:01:42,562 DEBUG [Listener at localhost/44797] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:42,562 DEBUG [Listener at localhost/44797] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=d56dddf5ec60b85220f3cc55e40fcd2a-90f4030c10e245eda17576645e40500c 2023-02-18 15:01:42,565 INFO [Listener at localhost/44797] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 15:01:42,568 DEBUG [Listener at localhost/44797] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:42,568 INFO [Listener at localhost/44797] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:42,569 DEBUG [Listener at localhost/44797] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:42,572 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:42,573 DEBUG [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/762b8a41-76e7-0236-8083-55d161d180dd/testWithMockedMapReduceSingleRegion/8fd79756-fd6d-4541-bae0-bb19675af578/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1 2023-02-18 15:01:42,573 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d56dddf5ec60b85220f3cc55e40fcd2a columnFamilyName f1 2023-02-18 15:01:42,577 DEBUG [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] regionserver.HStore(539): loaded hdfs://localhost:34073/user/jenkins/test-data/762b8a41-76e7-0236-8083-55d161d180dd/testWithMockedMapReduceSingleRegion/8fd79756-fd6d-4541-bae0-bb19675af578/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1/testWithMockedMapReduceSingleRegion=d56dddf5ec60b85220f3cc55e40fcd2a-3016470fb4d44ab6b44b46b0a8025f23 2023-02-18 15:01:42,577 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] regionserver.HStore(310): Store=d56dddf5ec60b85220f3cc55e40fcd2a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:42,577 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:42,583 DEBUG [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34073/user/jenkins/test-data/762b8a41-76e7-0236-8083-55d161d180dd/testWithMockedMapReduceSingleRegion/8fd79756-fd6d-4541-bae0-bb19675af578/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2 2023-02-18 15:01:42,583 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d56dddf5ec60b85220f3cc55e40fcd2a columnFamilyName f2 2023-02-18 15:01:42,588 DEBUG [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] regionserver.HStore(539): loaded hdfs://localhost:34073/user/jenkins/test-data/762b8a41-76e7-0236-8083-55d161d180dd/testWithMockedMapReduceSingleRegion/8fd79756-fd6d-4541-bae0-bb19675af578/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2/testWithMockedMapReduceSingleRegion=d56dddf5ec60b85220f3cc55e40fcd2a-90f4030c10e245eda17576645e40500c 2023-02-18 15:01:42,588 INFO [StoreOpener-d56dddf5ec60b85220f3cc55e40fcd2a-1] regionserver.HStore(310): Store=d56dddf5ec60b85220f3cc55e40fcd2a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:42,588 DEBUG [Listener at localhost/44797] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:42,589 INFO [Listener at localhost/44797] regionserver.HRegion(1071): Opened d56dddf5ec60b85220f3cc55e40fcd2a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70806015, jitterRate=0.055091843008995056}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:42,589 DEBUG [Listener at localhost/44797] regionserver.HRegion(964): Region open journal for d56dddf5ec60b85220f3cc55e40fcd2a: 2023-02-18 15:01:42,635 DEBUG [Listener at localhost/44797] regionserver.HRegion(1603): Closing d56dddf5ec60b85220f3cc55e40fcd2a, disabling compactions & flushes 2023-02-18 15:01:42,636 INFO [Listener at localhost/44797] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,636 DEBUG [Listener at localhost/44797] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,636 DEBUG [Listener at localhost/44797] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. after waiting 0 ms 2023-02-18 15:01:42,636 DEBUG [Listener at localhost/44797] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,636 INFO [Listener at localhost/44797] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,637 DEBUG [Listener at localhost/44797] regionserver.HRegion(1557): Region close journal for d56dddf5ec60b85220f3cc55e40fcd2a: 2023-02-18 15:01:42,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-18 15:01:42,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,643 INFO [Listener at localhost/44797] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:42,646 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732502646"}]},"ts":"1676732502646"} 2023-02-18 15:01:42,647 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-18 15:01:42,649 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-18 15:01:42,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d56dddf5ec60b85220f3cc55e40fcd2a, UNASSIGN}] 2023-02-18 15:01:42,651 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d56dddf5ec60b85220f3cc55e40fcd2a, UNASSIGN 2023-02-18 15:01:42,651 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d56dddf5ec60b85220f3cc55e40fcd2a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:42,651 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676732502651"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732502651"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732502651"}]},"ts":"1676732502651"} 2023-02-18 15:01:42,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure d56dddf5ec60b85220f3cc55e40fcd2a, server=jenkins-hbase4.apache.org,39373,1676732499864}] 2023-02-18 15:01:42,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:42,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:42,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d56dddf5ec60b85220f3cc55e40fcd2a, disabling compactions & flushes 2023-02-18 15:01:42,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. after waiting 0 ms 2023-02-18 15:01:42,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:42,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a. 2023-02-18 15:01:42,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d56dddf5ec60b85220f3cc55e40fcd2a: 2023-02-18 15:01:42,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:42,811 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d56dddf5ec60b85220f3cc55e40fcd2a, regionState=CLOSED 2023-02-18 15:01:42,811 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676732502811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732502811"}]},"ts":"1676732502811"} 2023-02-18 15:01:42,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 15:01:42,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure d56dddf5ec60b85220f3cc55e40fcd2a, server=jenkins-hbase4.apache.org,39373,1676732499864 in 160 msec 2023-02-18 15:01:42,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 15:01:42,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d56dddf5ec60b85220f3cc55e40fcd2a, UNASSIGN in 164 msec 2023-02-18 15:01:42,815 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732502815"}]},"ts":"1676732502815"} 2023-02-18 15:01:42,817 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-18 15:01:42,818 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-18 15:01:42,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-18 15:01:42,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:42,950 INFO [Listener at localhost/44797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-18 15:01:42,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,953 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,953 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 15:01:42,956 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:42,958 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1, FileablePath, hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2, FileablePath, hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/recovered.edits] 2023-02-18 15:01:42,960 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1/3016470fb4d44ab6b44b46b0a8025f23 to hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/archive/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1/3016470fb4d44ab6b44b46b0a8025f23 2023-02-18 15:01:42,961 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1/baaf25f62d914146985641e4c7c614bd to hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/archive/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f1/baaf25f62d914146985641e4c7c614bd 2023-02-18 15:01:42,963 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2/817416fbf74d4ff3aa00565f7cd91ea6 to hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/archive/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2/817416fbf74d4ff3aa00565f7cd91ea6 2023-02-18 15:01:42,964 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2/90f4030c10e245eda17576645e40500c to hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/archive/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/f2/90f4030c10e245eda17576645e40500c 2023-02-18 15:01:42,967 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/recovered.edits/12.seqid to hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/archive/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a/recovered.edits/12.seqid 2023-02-18 15:01:42,967 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/.tmp/data/default/testWithMockedMapReduceSingleRegion/d56dddf5ec60b85220f3cc55e40fcd2a 2023-02-18 15:01:42,967 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-18 15:01:42,969 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,970 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-18 15:01:42,971 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-18 15:01:42,972 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,972 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-18 15:01:42,972 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732502972"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:42,973 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 15:01:42,973 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d56dddf5ec60b85220f3cc55e40fcd2a, NAME => 'testWithMockedMapReduceSingleRegion,,1676732500899.d56dddf5ec60b85220f3cc55e40fcd2a.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 15:01:42,973 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-18 15:01:42,973 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676732502973"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:42,974 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-18 15:01:42,976 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 15:01:42,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-18 15:01:43,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44839] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 15:01:43,056 INFO [Listener at localhost/44797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-18 15:01:43,056 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 15:01:43,056 INFO [Listener at localhost/44797] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 15:01:43,056 DEBUG [Listener at localhost/44797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7aa7551c to 127.0.0.1:52932 2023-02-18 15:01:43,056 DEBUG [Listener at localhost/44797] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:43,056 DEBUG [Listener at localhost/44797] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 15:01:43,056 DEBUG [Listener at localhost/44797] util.JVMClusterUtil(257): Found active master hash=637370329, stopped=false 2023-02-18 15:01:43,057 INFO [Listener at localhost/44797] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44839,1676732499800 2023-02-18 15:01:43,060 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:43,060 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:43,060 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:43,060 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:43,060 INFO [Listener at localhost/44797] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 15:01:43,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:43,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:43,061 DEBUG [Listener at localhost/44797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x615d3a93 to 127.0.0.1:52932 2023-02-18 15:01:43,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:43,062 DEBUG [Listener at localhost/44797] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:43,062 INFO [Listener at localhost/44797] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43565,1676732499841' ***** 2023-02-18 15:01:43,062 INFO [Listener at localhost/44797] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:43,062 INFO [Listener at localhost/44797] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39373,1676732499864' ***** 2023-02-18 15:01:43,062 INFO [Listener at localhost/44797] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:43,062 INFO [RS:0;jenkins-hbase4:43565] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:43,062 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:43,062 INFO [RS:0;jenkins-hbase4:43565] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:43,062 INFO [RS:1;jenkins-hbase4:39373] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:43,063 INFO [RS:0;jenkins-hbase4:43565] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:43,063 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:43,063 INFO [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(3304): Received CLOSE for 4c1257b543c57f4cbb126dbb76313bc9 2023-02-18 15:01:43,063 INFO [RS:1;jenkins-hbase4:39373] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:43,064 INFO [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:43,064 INFO [RS:1;jenkins-hbase4:39373] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:43,064 DEBUG [RS:0;jenkins-hbase4:43565] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1869eb19 to 127.0.0.1:52932 2023-02-18 15:01:43,064 INFO [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:43,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4c1257b543c57f4cbb126dbb76313bc9, disabling compactions & flushes 2023-02-18 15:01:43,064 DEBUG [RS:1;jenkins-hbase4:39373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71c69617 to 127.0.0.1:52932 2023-02-18 15:01:43,064 DEBUG [RS:0;jenkins-hbase4:43565] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:43,065 DEBUG [RS:1;jenkins-hbase4:39373] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:43,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:43,065 INFO [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39373,1676732499864; all regions closed. 2023-02-18 15:01:43,065 INFO [RS:0;jenkins-hbase4:43565] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:43,065 INFO [RS:0;jenkins-hbase4:43565] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:43,065 INFO [RS:0;jenkins-hbase4:43565] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:43,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:43,065 INFO [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 15:01:43,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. after waiting 0 ms 2023-02-18 15:01:43,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:43,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4c1257b543c57f4cbb126dbb76313bc9 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 15:01:43,065 INFO [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-18 15:01:43,065 DEBUG [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 4c1257b543c57f4cbb126dbb76313bc9=hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9.} 2023-02-18 15:01:43,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:43,065 DEBUG [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1505): Waiting on 1588230740, 4c1257b543c57f4cbb126dbb76313bc9 2023-02-18 15:01:43,065 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:43,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:43,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:43,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:43,066 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-18 15:01:43,071 DEBUG [RS:1;jenkins-hbase4:39373] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/oldWALs 2023-02-18 15:01:43,071 INFO [RS:1;jenkins-hbase4:39373] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39373%2C1676732499864:(num 1676732501158) 2023-02-18 15:01:43,071 DEBUG [RS:1;jenkins-hbase4:39373] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:43,071 INFO [RS:1;jenkins-hbase4:39373] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:43,071 INFO [RS:1;jenkins-hbase4:39373] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:43,071 INFO [RS:1;jenkins-hbase4:39373] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:43,071 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:43,071 INFO [RS:1;jenkins-hbase4:39373] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:43,071 INFO [RS:1;jenkins-hbase4:39373] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:43,072 INFO [RS:1;jenkins-hbase4:39373] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39373 2023-02-18 15:01:43,076 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:43,076 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:43,076 ERROR [Listener at localhost/44797-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@796de406 rejected from java.util.concurrent.ThreadPoolExecutor@7d527ff3[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:43,076 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39373,1676732499864 2023-02-18 15:01:43,076 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:43,076 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:43,076 ERROR [Listener at localhost/44797-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f79fbb8 rejected from java.util.concurrent.ThreadPoolExecutor@7d527ff3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:43,076 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39373,1676732499864] 2023-02-18 15:01:43,076 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39373,1676732499864; numProcessing=1 2023-02-18 15:01:43,078 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39373,1676732499864 already deleted, retry=false 2023-02-18 15:01:43,078 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39373,1676732499864 expired; onlineServers=1 2023-02-18 15:01:43,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/.tmp/info/70b8f6c853134a429a600509d629d8f2 2023-02-18 15:01:43,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9/.tmp/info/004d033f8b1b4f5abe76b967b1937cae 2023-02-18 15:01:43,083 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70b8f6c853134a429a600509d629d8f2 2023-02-18 15:01:43,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9/.tmp/info/004d033f8b1b4f5abe76b967b1937cae as hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9/info/004d033f8b1b4f5abe76b967b1937cae 2023-02-18 15:01:43,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9/info/004d033f8b1b4f5abe76b967b1937cae, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 15:01:43,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4c1257b543c57f4cbb126dbb76313bc9 in 24ms, sequenceid=6, compaction requested=false 2023-02-18 15:01:43,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/.tmp/rep_barrier/a8c26a0b5b1e42d6885da93580cb0041 2023-02-18 15:01:43,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/namespace/4c1257b543c57f4cbb126dbb76313bc9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 15:01:43,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:43,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4c1257b543c57f4cbb126dbb76313bc9: 2023-02-18 15:01:43,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676732500404.4c1257b543c57f4cbb126dbb76313bc9. 2023-02-18 15:01:43,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8c26a0b5b1e42d6885da93580cb0041 2023-02-18 15:01:43,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/.tmp/table/2a1440cecbbd4446993b17c5f33f8b5c 2023-02-18 15:01:43,105 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a1440cecbbd4446993b17c5f33f8b5c 2023-02-18 15:01:43,105 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/.tmp/info/70b8f6c853134a429a600509d629d8f2 as hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/info/70b8f6c853134a429a600509d629d8f2 2023-02-18 15:01:43,109 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70b8f6c853134a429a600509d629d8f2 2023-02-18 15:01:43,109 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/info/70b8f6c853134a429a600509d629d8f2, entries=12, sequenceid=21, filesize=6.3 K 2023-02-18 15:01:43,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/.tmp/rep_barrier/a8c26a0b5b1e42d6885da93580cb0041 as hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/rep_barrier/a8c26a0b5b1e42d6885da93580cb0041 2023-02-18 15:01:43,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8c26a0b5b1e42d6885da93580cb0041 2023-02-18 15:01:43,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/rep_barrier/a8c26a0b5b1e42d6885da93580cb0041, entries=1, sequenceid=21, filesize=5.0 K 2023-02-18 15:01:43,114 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/.tmp/table/2a1440cecbbd4446993b17c5f33f8b5c as hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/table/2a1440cecbbd4446993b17c5f33f8b5c 2023-02-18 15:01:43,117 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a1440cecbbd4446993b17c5f33f8b5c 2023-02-18 15:01:43,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/table/2a1440cecbbd4446993b17c5f33f8b5c, entries=4, sequenceid=21, filesize=5.1 K 2023-02-18 15:01:43,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=21, compaction requested=false 2023-02-18 15:01:43,124 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 15:01:43,124 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 15:01:43,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:43,124 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:43,124 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:43,135 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:43,136 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-18 15:01:43,136 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-18 15:01:43,138 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:43,227 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 15:01:43,259 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:43,259 INFO [RS:1;jenkins-hbase4:39373] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39373,1676732499864; zookeeper connection closed. 2023-02-18 15:01:43,259 ERROR [Listener at localhost/44797-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@67613aa5 rejected from java.util.concurrent.ThreadPoolExecutor@7d527ff3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:43,259 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:39373-0x10067f3710b0002, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:43,259 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2a3accb6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2a3accb6 2023-02-18 15:01:43,259 ERROR [Listener at localhost/44797-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@88b85fe rejected from java.util.concurrent.ThreadPoolExecutor@7d527ff3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:43,265 INFO [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43565,1676732499841; all regions closed. 2023-02-18 15:01:43,269 DEBUG [RS:0;jenkins-hbase4:43565] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/oldWALs 2023-02-18 15:01:43,269 INFO [RS:0;jenkins-hbase4:43565] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43565%2C1676732499841.meta:.meta(num 1676732500345) 2023-02-18 15:01:43,274 DEBUG [RS:0;jenkins-hbase4:43565] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/oldWALs 2023-02-18 15:01:43,274 INFO [RS:0;jenkins-hbase4:43565] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43565%2C1676732499841:(num 1676732500757) 2023-02-18 15:01:43,274 DEBUG [RS:0;jenkins-hbase4:43565] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:43,274 INFO [RS:0;jenkins-hbase4:43565] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:43,275 INFO [RS:0;jenkins-hbase4:43565] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:43,275 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:43,276 INFO [RS:0;jenkins-hbase4:43565] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43565 2023-02-18 15:01:43,278 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43565,1676732499841 2023-02-18 15:01:43,278 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:43,278 ERROR [Listener at localhost/44797-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40db1384 rejected from java.util.concurrent.ThreadPoolExecutor@44e49f47[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:43,278 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43565,1676732499841] 2023-02-18 15:01:43,278 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43565,1676732499841; numProcessing=2 2023-02-18 15:01:43,281 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43565,1676732499841 already deleted, retry=false 2023-02-18 15:01:43,281 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43565,1676732499841 expired; onlineServers=0 2023-02-18 15:01:43,281 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44839,1676732499800' ***** 2023-02-18 15:01:43,281 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 15:01:43,281 DEBUG [M:0;jenkins-hbase4:44839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21c2efbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:43,281 INFO [M:0;jenkins-hbase4:44839] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44839,1676732499800 2023-02-18 15:01:43,281 INFO [M:0;jenkins-hbase4:44839] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44839,1676732499800; all regions closed. 2023-02-18 15:01:43,281 DEBUG [M:0;jenkins-hbase4:44839] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:43,281 DEBUG [M:0;jenkins-hbase4:44839] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 15:01:43,282 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 15:01:43,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732499997] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732499997,5,FailOnTimeoutGroup] 2023-02-18 15:01:43,282 DEBUG [M:0;jenkins-hbase4:44839] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 15:01:43,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732499998] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732499998,5,FailOnTimeoutGroup] 2023-02-18 15:01:43,282 INFO [M:0;jenkins-hbase4:44839] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 15:01:43,283 INFO [M:0;jenkins-hbase4:44839] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 15:01:43,283 INFO [M:0;jenkins-hbase4:44839] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 15:01:43,283 DEBUG [M:0;jenkins-hbase4:44839] master.HMaster(1512): Stopping service threads 2023-02-18 15:01:43,283 INFO [M:0;jenkins-hbase4:44839] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 15:01:43,284 ERROR [M:0;jenkins-hbase4:44839] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 15:01:43,284 INFO [M:0;jenkins-hbase4:44839] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 15:01:43,284 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 15:01:43,285 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:43,285 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:43,285 DEBUG [M:0;jenkins-hbase4:44839] zookeeper.ZKUtil(398): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 15:01:43,285 WARN [M:0;jenkins-hbase4:44839] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 15:01:43,285 INFO [M:0;jenkins-hbase4:44839] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 15:01:43,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:43,286 INFO [M:0;jenkins-hbase4:44839] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 15:01:43,286 DEBUG [M:0;jenkins-hbase4:44839] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:43,286 INFO [M:0;jenkins-hbase4:44839] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:43,286 DEBUG [M:0;jenkins-hbase4:44839] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:43,286 DEBUG [M:0;jenkins-hbase4:44839] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:43,286 DEBUG [M:0;jenkins-hbase4:44839] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:43,286 INFO [M:0;jenkins-hbase4:44839] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.13 KB heapSize=67.06 KB 2023-02-18 15:01:43,301 INFO [M:0;jenkins-hbase4:44839] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.13 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/53cfeafdda3a438da4161f4fdc74ad14 2023-02-18 15:01:43,310 DEBUG [M:0;jenkins-hbase4:44839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/53cfeafdda3a438da4161f4fdc74ad14 as hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/53cfeafdda3a438da4161f4fdc74ad14 2023-02-18 15:01:43,321 INFO [M:0;jenkins-hbase4:44839] regionserver.HStore(1080): Added hdfs://localhost:34073/user/jenkins/test-data/f585c604-333a-2ce7-19fd-0ccbe97052e3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/53cfeafdda3a438da4161f4fdc74ad14, entries=17, sequenceid=132, filesize=8.7 K 2023-02-18 15:01:43,322 INFO [M:0;jenkins-hbase4:44839] regionserver.HRegion(2947): Finished flush of dataSize ~56.13 KB/57474, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 36ms, sequenceid=132, compaction requested=false 2023-02-18 15:01:43,324 INFO [M:0;jenkins-hbase4:44839] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:43,324 DEBUG [M:0;jenkins-hbase4:44839] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:43,332 INFO [M:0;jenkins-hbase4:44839] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 15:01:43,332 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:43,337 INFO [M:0;jenkins-hbase4:44839] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44839 2023-02-18 15:01:43,340 DEBUG [M:0;jenkins-hbase4:44839] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44839,1676732499800 already deleted, retry=false 2023-02-18 15:01:43,659 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:43,659 INFO [M:0;jenkins-hbase4:44839] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44839,1676732499800; zookeeper connection closed. 2023-02-18 15:01:43,660 ERROR [Listener at localhost/44797-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@57fb13ca rejected from java.util.concurrent.ThreadPoolExecutor@53c48ded[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:43,662 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): master:44839-0x10067f3710b0000, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:43,662 ERROR [Listener at localhost/44797-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@28700dba rejected from java.util.concurrent.ThreadPoolExecutor@53c48ded[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:43,760 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:43,760 INFO [RS:0;jenkins-hbase4:43565] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43565,1676732499841; zookeeper connection closed. 2023-02-18 15:01:43,760 ERROR [Listener at localhost/44797-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2872e8f8 rejected from java.util.concurrent.ThreadPoolExecutor@44e49f47[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:43,760 DEBUG [Listener at localhost/44797-EventThread] zookeeper.ZKWatcher(600): regionserver:43565-0x10067f3710b0001, quorum=127.0.0.1:52932, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:43,760 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@b93a022] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@b93a022 2023-02-18 15:01:43,760 ERROR [Listener at localhost/44797-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50d336b4 rejected from java.util.concurrent.ThreadPoolExecutor@44e49f47[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:43,760 INFO [Listener at localhost/44797] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 15:01:43,761 WARN [Listener at localhost/44797] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:43,764 INFO [Listener at localhost/44797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:43,867 WARN [BP-311663519-172.31.14.131-1676732499091 heartbeating to localhost/127.0.0.1:34073] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:43,867 WARN [BP-311663519-172.31.14.131-1676732499091 heartbeating to localhost/127.0.0.1:34073] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-311663519-172.31.14.131-1676732499091 (Datanode Uuid e0e72535-1da1-44cc-83f7-1a6e93df51e4) service to localhost/127.0.0.1:34073 2023-02-18 15:01:43,868 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/cluster_e46071a7-bd75-2e14-0534-2183e1204ce4/dfs/data/data3/current/BP-311663519-172.31.14.131-1676732499091] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:43,868 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/cluster_e46071a7-bd75-2e14-0534-2183e1204ce4/dfs/data/data4/current/BP-311663519-172.31.14.131-1676732499091] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:43,869 WARN [Listener at localhost/44797] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:43,872 INFO [Listener at localhost/44797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:43,977 WARN [BP-311663519-172.31.14.131-1676732499091 heartbeating to localhost/127.0.0.1:34073] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:43,978 WARN [BP-311663519-172.31.14.131-1676732499091 heartbeating to localhost/127.0.0.1:34073] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-311663519-172.31.14.131-1676732499091 (Datanode Uuid 3f1a512a-d5d3-4d31-bb40-94e25d54bc4e) service to localhost/127.0.0.1:34073 2023-02-18 15:01:43,978 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/cluster_e46071a7-bd75-2e14-0534-2183e1204ce4/dfs/data/data1/current/BP-311663519-172.31.14.131-1676732499091] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:43,978 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/cluster_e46071a7-bd75-2e14-0534-2183e1204ce4/dfs/data/data2/current/BP-311663519-172.31.14.131-1676732499091] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:43,987 INFO [Listener at localhost/44797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:44,100 INFO [Listener at localhost/44797] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 15:01:44,118 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 15:01:44,130 INFO [Listener at localhost/44797] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=252 (was 228) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34073 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34073 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34073 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:34073 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44839,1676732499800)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34073 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/44797 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44797.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:34073 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34073 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=660 (was 641) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=363 (was 343) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=8571 (was 8659) 2023-02-18 15:01:44,141 INFO [Listener at localhost/44797] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=252, OpenFileDescriptor=660, MaxFileDescriptor=60000, SystemLoadAverage=363, ProcessCount=171, AvailableMemoryMB=8571 2023-02-18 15:01:44,152 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/hadoop.log.dir so I do NOT create it in target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e 2023-02-18 15:01:44,152 WARN [Listener at localhost/44797] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 15:01:44,152 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/hadoop.tmp.dir so I do NOT create it in target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e 2023-02-18 15:01:44,152 WARN [Listener at localhost/44797] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c15ffd08-3f09-0921-5d1a-5cb054693735/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 15:01:44,152 DEBUG [Listener at localhost/44797] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e 2023-02-18 15:01:44,152 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 15:01:44,153 INFO [Listener at localhost/44797] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/cluster_eb1a7933-129c-0f45-51df-0562ef6b8221, deleteOnExit=true 2023-02-18 15:01:44,153 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 15:01:44,153 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/test.cache.data in system properties and HBase conf 2023-02-18 15:01:44,153 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 15:01:44,153 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/hadoop.log.dir in system properties and HBase conf 2023-02-18 15:01:44,153 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 15:01:44,153 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 15:01:44,153 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 15:01:44,153 DEBUG [Listener at localhost/44797] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 15:01:44,153 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/nfs.dump.dir in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/java.io.tmpdir in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:44,154 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 15:01:44,155 INFO [Listener at localhost/44797] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 15:01:44,159 WARN [Listener at localhost/44797] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:44,159 WARN [Listener at localhost/44797] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:44,197 WARN [Listener at localhost/44797] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:44,199 INFO [Listener at localhost/44797] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:44,205 INFO [Listener at localhost/44797] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/java.io.tmpdir/Jetty_localhost_41577_hdfs____l9ayua/webapp 2023-02-18 15:01:44,296 INFO [Listener at localhost/44797] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41577 2023-02-18 15:01:44,300 WARN [Listener at localhost/44797] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:44,301 WARN [Listener at localhost/44797] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:44,344 WARN [Listener at localhost/40941] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:44,366 WARN [Listener at localhost/40941] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:44,368 WARN [Listener at localhost/40941] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:44,369 INFO [Listener at localhost/40941] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:44,378 INFO [Listener at localhost/40941] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/java.io.tmpdir/Jetty_localhost_40403_datanode____ra38gy/webapp 2023-02-18 15:01:44,469 INFO [Listener at localhost/40941] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40403 2023-02-18 15:01:44,478 WARN [Listener at localhost/44341] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:44,490 WARN [Listener at localhost/44341] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:44,491 WARN [Listener at localhost/44341] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:44,492 INFO [Listener at localhost/44341] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:44,496 INFO [Listener at localhost/44341] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/java.io.tmpdir/Jetty_localhost_45483_datanode____.askb9n/webapp 2023-02-18 15:01:44,569 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaa7a4d2570b3a70b: Processing first storage report for DS-e317fd54-478a-48c6-a00d-190115994459 from datanode ec291ec3-4277-4568-9d28-17d5c80f8cf1 2023-02-18 15:01:44,569 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaa7a4d2570b3a70b: from storage DS-e317fd54-478a-48c6-a00d-190115994459 node DatanodeRegistration(127.0.0.1:46649, datanodeUuid=ec291ec3-4277-4568-9d28-17d5c80f8cf1, infoPort=40071, infoSecurePort=0, ipcPort=44341, storageInfo=lv=-57;cid=testClusterID;nsid=1055172048;c=1676732504162), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 15:01:44,569 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaa7a4d2570b3a70b: Processing first storage report for DS-b1039afb-f23d-44dd-8d36-9a29635d39ee from datanode ec291ec3-4277-4568-9d28-17d5c80f8cf1 2023-02-18 15:01:44,569 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaa7a4d2570b3a70b: from storage DS-b1039afb-f23d-44dd-8d36-9a29635d39ee node DatanodeRegistration(127.0.0.1:46649, datanodeUuid=ec291ec3-4277-4568-9d28-17d5c80f8cf1, infoPort=40071, infoSecurePort=0, ipcPort=44341, storageInfo=lv=-57;cid=testClusterID;nsid=1055172048;c=1676732504162), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:44,595 INFO [Listener at localhost/44341] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45483 2023-02-18 15:01:44,602 WARN [Listener at localhost/40369] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:44,691 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x768dc0be321aa5e0: Processing first storage report for DS-22655cb6-5974-4f90-a4ca-ec60f359b5de from datanode 3260b8dd-4cef-4fc6-af31-f780aa1e4516 2023-02-18 15:01:44,691 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x768dc0be321aa5e0: from storage DS-22655cb6-5974-4f90-a4ca-ec60f359b5de node DatanodeRegistration(127.0.0.1:40343, datanodeUuid=3260b8dd-4cef-4fc6-af31-f780aa1e4516, infoPort=45719, infoSecurePort=0, ipcPort=40369, storageInfo=lv=-57;cid=testClusterID;nsid=1055172048;c=1676732504162), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:44,691 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x768dc0be321aa5e0: Processing first storage report for DS-5c9f262b-f99f-4a13-b3d3-d902b579213c from datanode 3260b8dd-4cef-4fc6-af31-f780aa1e4516 2023-02-18 15:01:44,691 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x768dc0be321aa5e0: from storage DS-5c9f262b-f99f-4a13-b3d3-d902b579213c node DatanodeRegistration(127.0.0.1:40343, datanodeUuid=3260b8dd-4cef-4fc6-af31-f780aa1e4516, infoPort=45719, infoSecurePort=0, ipcPort=40369, storageInfo=lv=-57;cid=testClusterID;nsid=1055172048;c=1676732504162), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:44,708 DEBUG [Listener at localhost/40369] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e 2023-02-18 15:01:44,710 INFO [Listener at localhost/40369] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/cluster_eb1a7933-129c-0f45-51df-0562ef6b8221/zookeeper_0, clientPort=64821, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/cluster_eb1a7933-129c-0f45-51df-0562ef6b8221/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/cluster_eb1a7933-129c-0f45-51df-0562ef6b8221/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 15:01:44,711 INFO [Listener at localhost/40369] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64821 2023-02-18 15:01:44,711 INFO [Listener at localhost/40369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:44,713 INFO [Listener at localhost/40369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:44,726 INFO [Listener at localhost/40369] util.FSUtils(479): Created version file at hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941 with version=8 2023-02-18 15:01:44,726 INFO [Listener at localhost/40369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:44,727 INFO [Listener at localhost/40369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:44,728 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40941/user/jenkins/test-data/f333d5bc-dafe-0437-359e-0c6fbdaf6a53/hbase-staging 2023-02-18 15:01:44,729 INFO [Listener at localhost/40369] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:44,730 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:44,730 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:44,730 INFO [Listener at localhost/40369] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:44,730 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:44,730 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:44,730 INFO [Listener at localhost/40369] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:44,731 INFO [Listener at localhost/40369] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42503 2023-02-18 15:01:44,731 INFO [Listener at localhost/40369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:44,732 INFO [Listener at localhost/40369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:44,733 INFO [Listener at localhost/40369] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42503 connecting to ZooKeeper ensemble=127.0.0.1:64821 2023-02-18 15:01:44,739 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:425030x0, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:44,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42503-0x10067f3844b0000 connected 2023-02-18 15:01:44,759 DEBUG [Listener at localhost/40369] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:44,759 DEBUG [Listener at localhost/40369] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:44,760 DEBUG [Listener at localhost/40369] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:44,764 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42503 2023-02-18 15:01:44,764 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42503 2023-02-18 15:01:44,765 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42503 2023-02-18 15:01:44,768 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42503 2023-02-18 15:01:44,768 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42503 2023-02-18 15:01:44,768 INFO [Listener at localhost/40369] master.HMaster(444): hbase.rootdir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941, hbase.cluster.distributed=false 2023-02-18 15:01:44,780 INFO [Listener at localhost/40369] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:44,780 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:44,780 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:44,780 INFO [Listener at localhost/40369] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:44,781 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:44,781 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:44,781 INFO [Listener at localhost/40369] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:44,781 INFO [Listener at localhost/40369] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36433 2023-02-18 15:01:44,782 INFO [Listener at localhost/40369] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:44,782 DEBUG [Listener at localhost/40369] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:44,782 INFO [Listener at localhost/40369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:44,783 INFO [Listener at localhost/40369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:44,784 INFO [Listener at localhost/40369] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36433 connecting to ZooKeeper ensemble=127.0.0.1:64821 2023-02-18 15:01:44,786 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:364330x0, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:44,786 DEBUG [Listener at localhost/40369] zookeeper.ZKUtil(164): regionserver:364330x0, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:44,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36433-0x10067f3844b0001 connected 2023-02-18 15:01:44,788 DEBUG [Listener at localhost/40369] zookeeper.ZKUtil(164): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:44,788 DEBUG [Listener at localhost/40369] zookeeper.ZKUtil(164): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:44,790 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36433 2023-02-18 15:01:44,792 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36433 2023-02-18 15:01:44,794 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36433 2023-02-18 15:01:44,794 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36433 2023-02-18 15:01:44,794 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36433 2023-02-18 15:01:44,804 INFO [Listener at localhost/40369] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:44,804 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:44,805 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:44,805 INFO [Listener at localhost/40369] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:44,805 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:44,805 INFO [Listener at localhost/40369] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:44,805 INFO [Listener at localhost/40369] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:44,808 INFO [Listener at localhost/40369] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33607 2023-02-18 15:01:44,808 INFO [Listener at localhost/40369] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:44,809 DEBUG [Listener at localhost/40369] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:44,809 INFO [Listener at localhost/40369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:44,810 INFO [Listener at localhost/40369] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:44,811 INFO [Listener at localhost/40369] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33607 connecting to ZooKeeper ensemble=127.0.0.1:64821 2023-02-18 15:01:44,814 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:336070x0, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:44,814 DEBUG [Listener at localhost/40369] zookeeper.ZKUtil(164): regionserver:336070x0, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:44,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33607-0x10067f3844b0002 connected 2023-02-18 15:01:44,815 DEBUG [Listener at localhost/40369] zookeeper.ZKUtil(164): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:44,816 DEBUG [Listener at localhost/40369] zookeeper.ZKUtil(164): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:44,816 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33607 2023-02-18 15:01:44,817 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33607 2023-02-18 15:01:44,817 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33607 2023-02-18 15:01:44,821 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33607 2023-02-18 15:01:44,821 DEBUG [Listener at localhost/40369] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33607 2023-02-18 15:01:44,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42503,1676732504729 2023-02-18 15:01:44,826 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:44,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42503,1676732504729 2023-02-18 15:01:44,827 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:44,827 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:44,827 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:44,828 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:44,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:44,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42503,1676732504729 from backup master directory 2023-02-18 15:01:44,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:44,832 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42503,1676732504729 2023-02-18 15:01:44,832 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:44,832 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:44,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42503,1676732504729 2023-02-18 15:01:44,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/hbase.id with ID: 52f042ed-5806-478a-9852-596c95377283 2023-02-18 15:01:44,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:44,855 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:44,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x09c3c466 to 127.0.0.1:64821 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:44,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bf14f4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:44,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:44,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 15:01:44,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:44,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/data/master/store-tmp 2023-02-18 15:01:44,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:44,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:44,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:44,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:44,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:44,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:44,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:44,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:44,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/WALs/jenkins-hbase4.apache.org,42503,1676732504729 2023-02-18 15:01:44,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42503%2C1676732504729, suffix=, logDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/WALs/jenkins-hbase4.apache.org,42503,1676732504729, archiveDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/oldWALs, maxLogs=10 2023-02-18 15:01:44,899 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46649,DS-e317fd54-478a-48c6-a00d-190115994459,DISK] 2023-02-18 15:01:44,900 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40343,DS-22655cb6-5974-4f90-a4ca-ec60f359b5de,DISK] 2023-02-18 15:01:44,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/WALs/jenkins-hbase4.apache.org,42503,1676732504729/jenkins-hbase4.apache.org%2C42503%2C1676732504729.1676732504885 2023-02-18 15:01:44,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46649,DS-e317fd54-478a-48c6-a00d-190115994459,DISK], DatanodeInfoWithStorage[127.0.0.1:40343,DS-22655cb6-5974-4f90-a4ca-ec60f359b5de,DISK]] 2023-02-18 15:01:44,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:44,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:44,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:44,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:44,907 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:44,909 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 15:01:44,910 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 15:01:44,910 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:44,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:44,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:44,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:44,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:44,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65751319, jitterRate=-0.020228996872901917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:44,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:44,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 15:01:44,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 15:01:44,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 15:01:44,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 15:01:44,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 15:01:44,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 15:01:44,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 15:01:44,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 15:01:44,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 15:01:44,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 15:01:44,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 15:01:44,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 15:01:44,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 15:01:44,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 15:01:44,931 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:44,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 15:01:44,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 15:01:44,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 15:01:44,933 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:44,933 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:44,933 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:44,933 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:44,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42503,1676732504729, sessionid=0x10067f3844b0000, setting cluster-up flag (Was=false) 2023-02-18 15:01:44,940 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:44,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 15:01:44,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42503,1676732504729 2023-02-18 15:01:44,949 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:44,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 15:01:44,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42503,1676732504729 2023-02-18 15:01:44,954 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.hbase-snapshot/.tmp 2023-02-18 15:01:44,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:44,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:44,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:44,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:44,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:44,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 15:01:44,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:44,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:44,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:44,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676732534957 2023-02-18 15:01:44,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 15:01:44,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 15:01:44,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 15:01:44,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 15:01:44,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 15:01:44,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 15:01:44,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:44,960 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:44,960 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 15:01:44,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 15:01:44,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 15:01:44,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 15:01:44,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 15:01:44,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 15:01:44,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732504961,5,FailOnTimeoutGroup] 2023-02-18 15:01:44,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732504961,5,FailOnTimeoutGroup] 2023-02-18 15:01:44,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:44,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 15:01:44,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:44,961 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:44,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:44,968 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:44,969 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:44,969 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941 2023-02-18 15:01:44,974 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:44,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:44,975 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/info 2023-02-18 15:01:44,976 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:44,976 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:44,976 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:44,977 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:44,978 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:44,978 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:44,978 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:44,979 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/table 2023-02-18 15:01:44,979 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:44,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:44,980 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740 2023-02-18 15:01:44,980 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740 2023-02-18 15:01:44,981 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:44,982 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:44,984 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:44,984 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70440109, jitterRate=0.049639418721199036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:44,984 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:44,984 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:44,984 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:44,984 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:44,984 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:44,984 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:44,985 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:44,985 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:44,985 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:44,985 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 15:01:44,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 15:01:44,987 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 15:01:44,988 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 15:01:45,025 INFO [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(952): ClusterId : 52f042ed-5806-478a-9852-596c95377283 2023-02-18 15:01:45,025 INFO [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer(952): ClusterId : 52f042ed-5806-478a-9852-596c95377283 2023-02-18 15:01:45,025 DEBUG [RS:0;jenkins-hbase4:36433] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:45,025 DEBUG [RS:1;jenkins-hbase4:33607] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:45,027 DEBUG [RS:0;jenkins-hbase4:36433] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:45,027 DEBUG [RS:0;jenkins-hbase4:36433] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:45,027 DEBUG [RS:1;jenkins-hbase4:33607] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:45,027 DEBUG [RS:1;jenkins-hbase4:33607] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:45,030 DEBUG [RS:0;jenkins-hbase4:36433] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:45,031 DEBUG [RS:1;jenkins-hbase4:33607] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:45,031 DEBUG [RS:0;jenkins-hbase4:36433] zookeeper.ReadOnlyZKClient(139): Connect 0x43cf695a to 127.0.0.1:64821 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:45,032 DEBUG [RS:1;jenkins-hbase4:33607] zookeeper.ReadOnlyZKClient(139): Connect 0x19e95656 to 127.0.0.1:64821 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:45,036 DEBUG [RS:1;jenkins-hbase4:33607] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@172ebb1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:45,036 DEBUG [RS:0;jenkins-hbase4:36433] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d088f53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:45,036 DEBUG [RS:1;jenkins-hbase4:33607] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13113d26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:45,036 DEBUG [RS:0;jenkins-hbase4:36433] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4937022a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:45,045 DEBUG [RS:0;jenkins-hbase4:36433] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36433 2023-02-18 15:01:45,045 DEBUG [RS:1;jenkins-hbase4:33607] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33607 2023-02-18 15:01:45,045 INFO [RS:0;jenkins-hbase4:36433] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:45,045 INFO [RS:0;jenkins-hbase4:36433] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:45,045 INFO [RS:1;jenkins-hbase4:33607] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:45,045 INFO [RS:1;jenkins-hbase4:33607] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:45,045 DEBUG [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:45,045 DEBUG [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:45,046 INFO [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42503,1676732504729 with isa=jenkins-hbase4.apache.org/172.31.14.131:33607, startcode=1676732504804 2023-02-18 15:01:45,046 INFO [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42503,1676732504729 with isa=jenkins-hbase4.apache.org/172.31.14.131:36433, startcode=1676732504780 2023-02-18 15:01:45,046 DEBUG [RS:1;jenkins-hbase4:33607] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:45,046 DEBUG [RS:0;jenkins-hbase4:36433] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:45,047 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32853, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:45,048 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46205, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:45,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42503] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:45,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:45,050 DEBUG [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941 2023-02-18 15:01:45,050 DEBUG [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941 2023-02-18 15:01:45,050 DEBUG [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40941 2023-02-18 15:01:45,050 DEBUG [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40941 2023-02-18 15:01:45,050 DEBUG [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:45,050 DEBUG [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:45,054 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:45,055 DEBUG [RS:0;jenkins-hbase4:36433] zookeeper.ZKUtil(162): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:45,055 DEBUG [RS:1;jenkins-hbase4:33607] zookeeper.ZKUtil(162): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:45,055 WARN [RS:0;jenkins-hbase4:36433] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:45,055 WARN [RS:1;jenkins-hbase4:33607] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:45,055 INFO [RS:0;jenkins-hbase4:36433] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:45,055 INFO [RS:1;jenkins-hbase4:33607] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:45,055 DEBUG [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/WALs/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:45,055 DEBUG [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/WALs/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:45,055 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36433,1676732504780] 2023-02-18 15:01:45,055 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33607,1676732504804] 2023-02-18 15:01:45,059 DEBUG [RS:1;jenkins-hbase4:33607] zookeeper.ZKUtil(162): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:45,059 DEBUG [RS:0;jenkins-hbase4:36433] zookeeper.ZKUtil(162): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:45,060 DEBUG [RS:1;jenkins-hbase4:33607] zookeeper.ZKUtil(162): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:45,060 DEBUG [RS:0;jenkins-hbase4:36433] zookeeper.ZKUtil(162): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:45,060 DEBUG [RS:1;jenkins-hbase4:33607] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:45,060 DEBUG [RS:0;jenkins-hbase4:36433] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:45,060 INFO [RS:1;jenkins-hbase4:33607] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:45,060 INFO [RS:0;jenkins-hbase4:36433] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:45,064 INFO [RS:1;jenkins-hbase4:33607] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:45,064 INFO [RS:0;jenkins-hbase4:36433] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:45,064 INFO [RS:1;jenkins-hbase4:33607] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:45,064 INFO [RS:0;jenkins-hbase4:36433] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:45,064 INFO [RS:1;jenkins-hbase4:33607] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,064 INFO [RS:0;jenkins-hbase4:36433] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,066 INFO [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:45,068 INFO [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:45,069 INFO [RS:0;jenkins-hbase4:36433] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,069 INFO [RS:1;jenkins-hbase4:33607] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,070 DEBUG [RS:0;jenkins-hbase4:36433] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:1;jenkins-hbase4:33607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:0;jenkins-hbase4:36433] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:1;jenkins-hbase4:33607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:0;jenkins-hbase4:36433] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:1;jenkins-hbase4:33607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:0;jenkins-hbase4:36433] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:1;jenkins-hbase4:33607] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:0;jenkins-hbase4:36433] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:1;jenkins-hbase4:33607] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:0;jenkins-hbase4:36433] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:45,070 DEBUG [RS:1;jenkins-hbase4:33607] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:45,070 DEBUG [RS:0;jenkins-hbase4:36433] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:1;jenkins-hbase4:33607] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:0;jenkins-hbase4:36433] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:0;jenkins-hbase4:36433] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:1;jenkins-hbase4:33607] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:0;jenkins-hbase4:36433] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,070 DEBUG [RS:1;jenkins-hbase4:33607] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,071 DEBUG [RS:1;jenkins-hbase4:33607] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:45,071 INFO [RS:1;jenkins-hbase4:33607] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,071 INFO [RS:1;jenkins-hbase4:33607] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,071 INFO [RS:0;jenkins-hbase4:36433] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,072 INFO [RS:1;jenkins-hbase4:33607] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,072 INFO [RS:0;jenkins-hbase4:36433] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,073 INFO [RS:0;jenkins-hbase4:36433] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,083 INFO [RS:1;jenkins-hbase4:33607] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:45,083 INFO [RS:1;jenkins-hbase4:33607] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33607,1676732504804-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,086 INFO [RS:0;jenkins-hbase4:36433] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:45,086 INFO [RS:0;jenkins-hbase4:36433] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36433,1676732504780-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,096 INFO [RS:1;jenkins-hbase4:33607] regionserver.Replication(203): jenkins-hbase4.apache.org,33607,1676732504804 started 2023-02-18 15:01:45,096 INFO [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33607,1676732504804, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33607, sessionid=0x10067f3844b0002 2023-02-18 15:01:45,096 DEBUG [RS:1;jenkins-hbase4:33607] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:45,097 DEBUG [RS:1;jenkins-hbase4:33607] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:45,097 DEBUG [RS:1;jenkins-hbase4:33607] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33607,1676732504804' 2023-02-18 15:01:45,097 DEBUG [RS:1;jenkins-hbase4:33607] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:45,097 INFO [RS:0;jenkins-hbase4:36433] regionserver.Replication(203): jenkins-hbase4.apache.org,36433,1676732504780 started 2023-02-18 15:01:45,097 INFO [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36433,1676732504780, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36433, sessionid=0x10067f3844b0001 2023-02-18 15:01:45,097 DEBUG [RS:0;jenkins-hbase4:36433] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:45,097 DEBUG [RS:0;jenkins-hbase4:36433] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:45,097 DEBUG [RS:0;jenkins-hbase4:36433] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36433,1676732504780' 2023-02-18 15:01:45,097 DEBUG [RS:0;jenkins-hbase4:36433] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:45,097 DEBUG [RS:1;jenkins-hbase4:33607] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:45,097 DEBUG [RS:0;jenkins-hbase4:36433] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:45,097 DEBUG [RS:1;jenkins-hbase4:33607] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:45,097 DEBUG [RS:1;jenkins-hbase4:33607] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:45,097 DEBUG [RS:1;jenkins-hbase4:33607] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:45,097 DEBUG [RS:1;jenkins-hbase4:33607] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33607,1676732504804' 2023-02-18 15:01:45,097 DEBUG [RS:1;jenkins-hbase4:33607] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:45,097 DEBUG [RS:0;jenkins-hbase4:36433] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:45,098 DEBUG [RS:0;jenkins-hbase4:36433] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:45,098 DEBUG [RS:0;jenkins-hbase4:36433] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:45,098 DEBUG [RS:0;jenkins-hbase4:36433] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36433,1676732504780' 2023-02-18 15:01:45,098 DEBUG [RS:0;jenkins-hbase4:36433] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:45,098 DEBUG [RS:1;jenkins-hbase4:33607] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:45,098 DEBUG [RS:0;jenkins-hbase4:36433] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:45,098 DEBUG [RS:1;jenkins-hbase4:33607] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:45,098 DEBUG [RS:0;jenkins-hbase4:36433] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:45,098 INFO [RS:0;jenkins-hbase4:36433] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:45,098 INFO [RS:1;jenkins-hbase4:33607] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:45,098 INFO [RS:1;jenkins-hbase4:33607] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:45,098 INFO [RS:0;jenkins-hbase4:36433] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:45,138 DEBUG [jenkins-hbase4:42503] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 15:01:45,138 DEBUG [jenkins-hbase4:42503] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:45,140 DEBUG [jenkins-hbase4:42503] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:45,140 DEBUG [jenkins-hbase4:42503] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:45,140 DEBUG [jenkins-hbase4:42503] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:45,140 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36433,1676732504780, state=OPENING 2023-02-18 15:01:45,141 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 15:01:45,142 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:45,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36433,1676732504780}] 2023-02-18 15:01:45,143 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:45,297 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:45,297 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:45,299 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35952, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:45,303 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 15:01:45,303 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:45,305 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36433%2C1676732504780.meta, suffix=.meta, logDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/WALs/jenkins-hbase4.apache.org,36433,1676732504780, archiveDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/oldWALs, maxLogs=32 2023-02-18 15:01:45,321 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40343,DS-22655cb6-5974-4f90-a4ca-ec60f359b5de,DISK] 2023-02-18 15:01:45,321 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46649,DS-e317fd54-478a-48c6-a00d-190115994459,DISK] 2023-02-18 15:01:45,323 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/WALs/jenkins-hbase4.apache.org,36433,1676732504780/jenkins-hbase4.apache.org%2C36433%2C1676732504780.meta.1676732505305.meta 2023-02-18 15:01:45,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40343,DS-22655cb6-5974-4f90-a4ca-ec60f359b5de,DISK], DatanodeInfoWithStorage[127.0.0.1:46649,DS-e317fd54-478a-48c6-a00d-190115994459,DISK]] 2023-02-18 15:01:45,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:45,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 15:01:45,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 15:01:45,323 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 15:01:45,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 15:01:45,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:45,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 15:01:45,324 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 15:01:45,325 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:45,325 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/info 2023-02-18 15:01:45,325 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/info 2023-02-18 15:01:45,326 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:45,326 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:45,326 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:45,327 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:45,327 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:45,327 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:45,327 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:45,328 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:45,328 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/table 2023-02-18 15:01:45,328 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/table 2023-02-18 15:01:45,328 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:45,329 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:45,329 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740 2023-02-18 15:01:45,330 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740 2023-02-18 15:01:45,331 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:45,332 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:45,332 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66060849, jitterRate=-0.015616640448570251}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:45,332 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:45,333 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676732505297 2023-02-18 15:01:45,337 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 15:01:45,338 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 15:01:45,338 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36433,1676732504780, state=OPEN 2023-02-18 15:01:45,339 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 15:01:45,339 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:45,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 15:01:45,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36433,1676732504780 in 196 msec 2023-02-18 15:01:45,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 15:01:45,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-18 15:01:45,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 387 msec 2023-02-18 15:01:45,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676732505343, completionTime=-1 2023-02-18 15:01:45,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 15:01:45,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 15:01:45,346 DEBUG [hconnection-0x5f278e0e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:45,347 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35954, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:45,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 15:01:45,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676732565349 2023-02-18 15:01:45,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676732625349 2023-02-18 15:01:45,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-18 15:01:45,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42503,1676732504729-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42503,1676732504729-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42503,1676732504729-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42503, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:45,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 15:01:45,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:45,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 15:01:45,360 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 15:01:45,360 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:45,361 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:45,362 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42 2023-02-18 15:01:45,362 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42 empty. 2023-02-18 15:01:45,362 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42 2023-02-18 15:01:45,362 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 15:01:45,370 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:45,371 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4ca3e06fe1909437747f3ec26f8aee42, NAME => 'hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp 2023-02-18 15:01:45,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:45,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4ca3e06fe1909437747f3ec26f8aee42, disabling compactions & flushes 2023-02-18 15:01:45,377 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:45,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:45,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. after waiting 0 ms 2023-02-18 15:01:45,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:45,377 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:45,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4ca3e06fe1909437747f3ec26f8aee42: 2023-02-18 15:01:45,379 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:45,380 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732505379"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732505379"}]},"ts":"1676732505379"} 2023-02-18 15:01:45,381 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 15:01:45,381 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:45,381 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732505381"}]},"ts":"1676732505381"} 2023-02-18 15:01:45,382 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 15:01:45,385 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:45,386 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:45,386 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:45,386 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:45,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4ca3e06fe1909437747f3ec26f8aee42, ASSIGN}] 2023-02-18 15:01:45,388 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4ca3e06fe1909437747f3ec26f8aee42, ASSIGN 2023-02-18 15:01:45,389 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4ca3e06fe1909437747f3ec26f8aee42, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36433,1676732504780; forceNewPlan=false, retain=false 2023-02-18 15:01:45,539 INFO [jenkins-hbase4:42503] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 15:01:45,539 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4ca3e06fe1909437747f3ec26f8aee42, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:45,539 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732505539"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732505539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732505539"}]},"ts":"1676732505539"} 2023-02-18 15:01:45,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4ca3e06fe1909437747f3ec26f8aee42, server=jenkins-hbase4.apache.org,36433,1676732504780}] 2023-02-18 15:01:45,695 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:45,697 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36433%2C1676732504780, suffix=, logDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/WALs/jenkins-hbase4.apache.org,36433,1676732504780, archiveDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/oldWALs, maxLogs=32 2023-02-18 15:01:45,709 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40343,DS-22655cb6-5974-4f90-a4ca-ec60f359b5de,DISK] 2023-02-18 15:01:45,709 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46649,DS-e317fd54-478a-48c6-a00d-190115994459,DISK] 2023-02-18 15:01:45,711 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/WALs/jenkins-hbase4.apache.org,36433,1676732504780/jenkins-hbase4.apache.org%2C36433%2C1676732504780.1676732505697 2023-02-18 15:01:45,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40343,DS-22655cb6-5974-4f90-a4ca-ec60f359b5de,DISK], DatanodeInfoWithStorage[127.0.0.1:46649,DS-e317fd54-478a-48c6-a00d-190115994459,DISK]] 2023-02-18 15:01:45,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4ca3e06fe1909437747f3ec26f8aee42, NAME => 'hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:45,712 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4ca3e06fe1909437747f3ec26f8aee42 2023-02-18 15:01:45,712 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:45,712 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4ca3e06fe1909437747f3ec26f8aee42 2023-02-18 15:01:45,712 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4ca3e06fe1909437747f3ec26f8aee42 2023-02-18 15:01:45,713 INFO [StoreOpener-4ca3e06fe1909437747f3ec26f8aee42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4ca3e06fe1909437747f3ec26f8aee42 2023-02-18 15:01:45,714 DEBUG [StoreOpener-4ca3e06fe1909437747f3ec26f8aee42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42/info 2023-02-18 15:01:45,714 DEBUG [StoreOpener-4ca3e06fe1909437747f3ec26f8aee42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42/info 2023-02-18 15:01:45,714 INFO [StoreOpener-4ca3e06fe1909437747f3ec26f8aee42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ca3e06fe1909437747f3ec26f8aee42 columnFamilyName info 2023-02-18 15:01:45,715 INFO [StoreOpener-4ca3e06fe1909437747f3ec26f8aee42-1] regionserver.HStore(310): Store=4ca3e06fe1909437747f3ec26f8aee42/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:45,715 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42 2023-02-18 15:01:45,715 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42 2023-02-18 15:01:45,718 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4ca3e06fe1909437747f3ec26f8aee42 2023-02-18 15:01:45,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:45,721 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4ca3e06fe1909437747f3ec26f8aee42; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67228336, jitterRate=0.0017802715301513672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:45,721 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4ca3e06fe1909437747f3ec26f8aee42: 2023-02-18 15:01:45,721 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42., pid=6, masterSystemTime=1676732505692 2023-02-18 15:01:45,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:45,723 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:45,723 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4ca3e06fe1909437747f3ec26f8aee42, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:45,723 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732505723"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732505723"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732505723"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732505723"}]},"ts":"1676732505723"} 2023-02-18 15:01:45,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 15:01:45,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4ca3e06fe1909437747f3ec26f8aee42, server=jenkins-hbase4.apache.org,36433,1676732504780 in 183 msec 2023-02-18 15:01:45,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 15:01:45,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4ca3e06fe1909437747f3ec26f8aee42, ASSIGN in 340 msec 2023-02-18 15:01:45,728 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:45,728 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732505728"}]},"ts":"1676732505728"} 2023-02-18 15:01:45,730 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 15:01:45,733 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:45,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 375 msec 2023-02-18 15:01:45,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 15:01:45,761 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:45,761 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:45,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 15:01:45,772 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:45,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-18 15:01:45,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 15:01:45,783 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:45,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-18 15:01:45,790 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 15:01:45,793 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 15:01:45,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.961sec 2023-02-18 15:01:45,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 15:01:45,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 15:01:45,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 15:01:45,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42503,1676732504729-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 15:01:45,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42503,1676732504729-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 15:01:45,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 15:01:45,825 DEBUG [Listener at localhost/40369] zookeeper.ReadOnlyZKClient(139): Connect 0x4862dfc3 to 127.0.0.1:64821 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:45,828 DEBUG [Listener at localhost/40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ed005ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:45,830 DEBUG [hconnection-0x23f83723-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:45,832 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35960, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:45,833 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42503,1676732504729 2023-02-18 15:01:45,833 DEBUG [Listener at localhost/40369] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 15:01:45,835 DEBUG [Listener at localhost/40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 15:01:45,837 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60196, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 15:01:45,838 INFO [Listener at localhost/40369] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:45,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:45,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 15:01:45,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:60196 deadline: 1676732565839, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:45,839 INFO [Listener at localhost/40369] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 15:01:45,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:45,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:45,844 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:45,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-18 15:01:45,845 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:45,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:45,847 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:45,847 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef empty. 2023-02-18 15:01:45,848 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:45,848 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-18 15:01:45,862 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:45,863 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 17b32e9f6e3aa131a260418717721bef, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp 2023-02-18 15:01:45,870 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:45,870 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 17b32e9f6e3aa131a260418717721bef, disabling compactions & flushes 2023-02-18 15:01:45,870 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:45,870 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:45,870 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. after waiting 0 ms 2023-02-18 15:01:45,870 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:45,870 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:45,870 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 17b32e9f6e3aa131a260418717721bef: 2023-02-18 15:01:45,872 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:45,873 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676732505873"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732505873"}]},"ts":"1676732505873"} 2023-02-18 15:01:45,874 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 15:01:45,875 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:45,875 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732505875"}]},"ts":"1676732505875"} 2023-02-18 15:01:45,876 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-18 15:01:45,880 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:45,880 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:45,881 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:45,881 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:45,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=17b32e9f6e3aa131a260418717721bef, ASSIGN}] 2023-02-18 15:01:45,882 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=17b32e9f6e3aa131a260418717721bef, ASSIGN 2023-02-18 15:01:45,883 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=17b32e9f6e3aa131a260418717721bef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33607,1676732504804; forceNewPlan=false, retain=false 2023-02-18 15:01:45,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:46,033 INFO [jenkins-hbase4:42503] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 15:01:46,034 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=17b32e9f6e3aa131a260418717721bef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,034 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676732506034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732506034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732506034"}]},"ts":"1676732506034"} 2023-02-18 15:01:46,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 17b32e9f6e3aa131a260418717721bef, server=jenkins-hbase4.apache.org,33607,1676732504804}] 2023-02-18 15:01:46,100 INFO [RS:1;jenkins-hbase4:33607] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33607%2C1676732504804, suffix=, logDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/WALs/jenkins-hbase4.apache.org,33607,1676732504804, archiveDir=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/oldWALs, maxLogs=32 2023-02-18 15:01:46,115 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40343,DS-22655cb6-5974-4f90-a4ca-ec60f359b5de,DISK] 2023-02-18 15:01:46,115 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46649,DS-e317fd54-478a-48c6-a00d-190115994459,DISK] 2023-02-18 15:01:46,117 INFO [RS:1;jenkins-hbase4:33607] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/WALs/jenkins-hbase4.apache.org,33607,1676732504804/jenkins-hbase4.apache.org%2C33607%2C1676732504804.1676732506100 2023-02-18 15:01:46,117 DEBUG [RS:1;jenkins-hbase4:33607] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46649,DS-e317fd54-478a-48c6-a00d-190115994459,DISK], DatanodeInfoWithStorage[127.0.0.1:40343,DS-22655cb6-5974-4f90-a4ca-ec60f359b5de,DISK]] 2023-02-18 15:01:46,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:46,188 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,188 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:46,190 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40608, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:46,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:46,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 17b32e9f6e3aa131a260418717721bef, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:46,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:46,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:46,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:46,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:46,194 INFO [StoreOpener-17b32e9f6e3aa131a260418717721bef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:46,195 DEBUG [StoreOpener-17b32e9f6e3aa131a260418717721bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1 2023-02-18 15:01:46,196 DEBUG [StoreOpener-17b32e9f6e3aa131a260418717721bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1 2023-02-18 15:01:46,196 INFO [StoreOpener-17b32e9f6e3aa131a260418717721bef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17b32e9f6e3aa131a260418717721bef columnFamilyName f1 2023-02-18 15:01:46,196 INFO [StoreOpener-17b32e9f6e3aa131a260418717721bef-1] regionserver.HStore(310): Store=17b32e9f6e3aa131a260418717721bef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:46,197 INFO [StoreOpener-17b32e9f6e3aa131a260418717721bef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:46,198 DEBUG [StoreOpener-17b32e9f6e3aa131a260418717721bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2 2023-02-18 15:01:46,198 DEBUG [StoreOpener-17b32e9f6e3aa131a260418717721bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2 2023-02-18 15:01:46,198 INFO [StoreOpener-17b32e9f6e3aa131a260418717721bef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17b32e9f6e3aa131a260418717721bef columnFamilyName f2 2023-02-18 15:01:46,199 INFO [StoreOpener-17b32e9f6e3aa131a260418717721bef-1] regionserver.HStore(310): Store=17b32e9f6e3aa131a260418717721bef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:46,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:46,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:46,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:46,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:46,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:46,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 17b32e9f6e3aa131a260418717721bef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63630419, jitterRate=-0.05183286964893341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:46,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 17b32e9f6e3aa131a260418717721bef: 2023-02-18 15:01:46,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef., pid=12, masterSystemTime=1676732506188 2023-02-18 15:01:46,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:46,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:46,210 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=17b32e9f6e3aa131a260418717721bef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,210 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676732506210"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732506210"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732506210"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732506210"}]},"ts":"1676732506210"} 2023-02-18 15:01:46,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 15:01:46,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 17b32e9f6e3aa131a260418717721bef, server=jenkins-hbase4.apache.org,33607,1676732504804 in 176 msec 2023-02-18 15:01:46,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 15:01:46,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=17b32e9f6e3aa131a260418717721bef, ASSIGN in 332 msec 2023-02-18 15:01:46,215 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:46,215 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732506215"}]},"ts":"1676732506215"} 2023-02-18 15:01:46,216 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-18 15:01:46,219 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:46,221 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 377 msec 2023-02-18 15:01:46,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:46,450 INFO [Listener at localhost/40369] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-18 15:01:46,450 DEBUG [Listener at localhost/40369] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-18 15:01:46,450 INFO [Listener at localhost/40369] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:46,452 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-18 15:01:46,452 INFO [Listener at localhost/40369] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:46,453 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-18 15:01:46,453 INFO [Listener at localhost/40369] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 15:01:46,465 DEBUG [hconnection-0x23f83723-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:46,476 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40622, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:46,483 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33607] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:46,563 INFO [Listener at localhost/40369] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 15:01:46,563 INFO [Listener at localhost/40369] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 15:01:46,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-18 15:01:46,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676732506564 (current time:1676732506564). 2023-02-18 15:01:46,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 15:01:46,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] zookeeper.ReadOnlyZKClient(139): Connect 0x59236b73 to 127.0.0.1:64821 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:46,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6be0170e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:46,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:46,569 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35972, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:46,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59236b73 to 127.0.0.1:64821 2023-02-18 15:01:46,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:46,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 15:01:46,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-18 15:01:46,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-18 15:01:46,573 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-18 15:01:46,574 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676733106574 2023-02-18 15:01:46,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-18 15:01:46,574 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:46,575 DEBUG [Listener at localhost/40369] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:46,576 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-18 15:01:46,576 DEBUG [Listener at localhost/40369] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 15:01:46,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-18 15:01:46,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-18 15:01:46,578 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-18 15:01:46,578 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676733106578 2023-02-18 15:01:46,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-18 15:01:46,585 INFO [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-18 15:01:46,585 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:46,586 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-18 15:01:46,586 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-18 15:01:46,586 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,586 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-18 15:01:46,588 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:46,588 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:46,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:46,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:46,588 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 15:01:46,588 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,589 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 15:01:46,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-18 15:01:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 15:01:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-18 15:01:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 15:01:46,589 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-18 15:01:46,589 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-18 15:01:46,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 15:01:46,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 15:01:46,589 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 15:01:46,590 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:46,590 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 15:01:46,590 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:46,590 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 15:01:46,591 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 15:01:46,591 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 15:01:46,591 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 15:01:46,591 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36433,1676732504780' joining acquired barrier for procedure (foo) in zk 2023-02-18 15:01:46,591 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33607,1676732504804' joining acquired barrier for procedure (foo) in zk 2023-02-18 15:01:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,592 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:46,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33607,1676732504804' joining acquired barrier for procedure 'foo' on coordinator 2023-02-18 15:01:46,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67622354[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:46,594 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-18 15:01:46,594 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,595 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,595 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,595 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,595 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 15:01:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 15:01:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 15:01:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 15:01:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 15:01:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,36433,1676732504780' in zk 2023-02-18 15:01:46,595 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:46,595 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. started... 2023-02-18 15:01:46,595 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 17b32e9f6e3aa131a260418717721bef 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 15:01:46,596 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 15:01:46,597 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:46,597 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 15:01:46,610 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/.tmp/f1/c5f4d05534c54665bfff6c529bc2196b 2023-02-18 15:01:46,632 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/.tmp/f2/642534ef53dc4550b306c4874b8c5533 2023-02-18 15:01:46,637 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/.tmp/f1/c5f4d05534c54665bfff6c529bc2196b as hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/c5f4d05534c54665bfff6c529bc2196b 2023-02-18 15:01:46,644 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/c5f4d05534c54665bfff6c529bc2196b, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 15:01:46,645 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/.tmp/f2/642534ef53dc4550b306c4874b8c5533 as hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/642534ef53dc4550b306c4874b8c5533 2023-02-18 15:01:46,648 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/642534ef53dc4550b306c4874b8c5533, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 15:01:46,649 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 17b32e9f6e3aa131a260418717721bef in 54ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:46,649 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 15:01:46,650 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 17b32e9f6e3aa131a260418717721bef: 2023-02-18 15:01:46,650 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.' region-info for snapshot=foo 2023-02-18 15:01:46,650 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:46,650 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/c5f4d05534c54665bfff6c529bc2196b] hfiles 2023-02-18 15:01:46,650 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/c5f4d05534c54665bfff6c529bc2196b for snapshot=foo 2023-02-18 15:01:46,650 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/642534ef53dc4550b306c4874b8c5533] hfiles 2023-02-18 15:01:46,650 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/642534ef53dc4550b306c4874b8c5533 for snapshot=foo 2023-02-18 15:01:46,656 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. completed. 2023-02-18 15:01:46,656 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:46,656 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 15:01:46,656 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 15:01:46,656 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,656 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 15:01:46,656 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,33607,1676732504804' in zk 2023-02-18 15:01:46,659 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,659 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 15:01:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:46,659 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:46,659 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 15:01:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,33607,1676732504804': 2023-02-18 15:01:46,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33607,1676732504804' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-18 15:01:46,661 INFO [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-18 15:01:46,661 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:46,661 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:46,661 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-18 15:01:46,662 INFO [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 15:01:46,663 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,663 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,663 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,663 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:46,663 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:46,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:46,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:46,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,664 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:46,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:46,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:46,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:46,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:46,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:46,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:46,664 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,666 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:46,666 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 15:01:46,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:46,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,671 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:46,671 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,671 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:46,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-18 15:01:46,671 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 15:01:46,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:46,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:46,671 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:46,671 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:46,673 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:46,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-18 15:01:46,673 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 15:01:46,673 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:46,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:46,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:46,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:46,673 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:46,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:46,673 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,673 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:46,673 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 15:01:46,674 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 15:01:46,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.hbase-snapshot/.tmp/foo 2023-02-18 15:01:46,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:46,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:46,676 DEBUG [Listener at localhost/40369] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:46,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-18 15:01:46,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:46,678 DEBUG [Listener at localhost/40369] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 15:01:46,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.hbase-snapshot/.tmp/foo to hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.hbase-snapshot/foo 2023-02-18 15:01:46,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-18 15:01:46,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.hbase-snapshot/.tmp/foo 2023-02-18 15:01:46,710 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.hbase-snapshot/.tmp/foo 2023-02-18 15:01:46,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676732506574Consolidate snapshot: foo at 1676732506673 (+99 ms)Loading Region manifests for foo at 1676732506673Writing data manifest for foo at 1676732506675 (+2 ms)Verifying snapshot: foo at 1676732506686 (+11 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676732506710 (+24 ms) 2023-02-18 15:01:46,712 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-18 15:01:46,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 137 msec 2023-02-18 15:01:46,878 DEBUG [Listener at localhost/40369] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:46,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-18 15:01:46,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 15:01:46,879 INFO [Listener at localhost/40369] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 15:01:46,883 INFO [Listener at localhost/40369] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 15:01:46,888 INFO [Listener at localhost/40369] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 15:01:46,917 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33607] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:47,070 INFO [Listener at localhost/40369] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 15:01:47,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 15:01:47,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,078 INFO [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 15:01:47,078 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:47,079 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-18 15:01:47,079 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-18 15:01:47,080 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,080 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,082 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,082 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:47,082 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:47,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:47,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:47,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:47,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:47,082 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,082 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:47,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:47,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:47,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,083 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,083 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-18 15:01:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-18 15:01:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:47,083 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:47,084 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-18 15:01:47,085 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-18 15:01:47,085 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-18 15:01:47,085 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36433,1676732504780' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-18 15:01:47,085 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 15:01:47,085 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 15:01:47,085 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:47,085 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. started... 2023-02-18 15:01:47,086 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 17b32e9f6e3aa131a260418717721bef 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 15:01:47,087 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,087 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,087 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:47,102 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/.tmp/f1/02348e14bd8144a287f11a5b26d43f74 2023-02-18 15:01:47,120 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/.tmp/f2/6536ee76215e45f8b88ca3d16e8d2971 2023-02-18 15:01:47,123 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/.tmp/f1/02348e14bd8144a287f11a5b26d43f74 as hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/02348e14bd8144a287f11a5b26d43f74 2023-02-18 15:01:47,127 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/02348e14bd8144a287f11a5b26d43f74, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 15:01:47,127 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/.tmp/f2/6536ee76215e45f8b88ca3d16e8d2971 as hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/6536ee76215e45f8b88ca3d16e8d2971 2023-02-18 15:01:47,131 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/6536ee76215e45f8b88ca3d16e8d2971, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 15:01:47,132 INFO [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 17b32e9f6e3aa131a260418717721bef in 46ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:47,133 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 17b32e9f6e3aa131a260418717721bef: 2023-02-18 15:01:47,133 DEBUG [rs(jenkins-hbase4.apache.org,33607,1676732504804)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:47,133 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 15:01:47,133 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 15:01:47,133 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,133 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-18 15:01:47,133 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33607,1676732504804' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-18 15:01:47,134 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,134 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:47,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:47,135 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,135 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:47,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:47,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:47,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:47,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:47,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33607,1676732504804' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-18 15:01:47,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@635dab60[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:47,136 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-18 15:01:47,136 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,137 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,137 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,137 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-18 15:01:47,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,138 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,138 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-18 15:01:47,138 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-18 15:01:47,138 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-18 15:01:47,138 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,36433,1676732504780' in zk 2023-02-18 15:01:47,138 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,33607,1676732504804' in zk 2023-02-18 15:01:47,138 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:47,140 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-18 15:01:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:47,140 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-18 15:01:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,33607,1676732504804' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-18 15:01:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,36433,1676732504780' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-18 15:01:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,33607,1676732504804': 2023-02-18 15:01:47,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33607,1676732504804' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-18 15:01:47,143 INFO [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-18 15:01:47,143 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:47,143 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:47,143 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,143 INFO [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 15:01:47,145 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,145 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:47,145 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:47,145 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,145 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:47,145 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:47,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:47,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,146 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,147 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:47,148 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,150 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,150 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:47,150 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:47,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:47,150 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:47,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 15:01:47,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 15:01:47,150 DEBUG [(jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:47,150 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:47,150 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,150 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,150 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,151 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:47,151 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,151 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,150 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:47,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:47,151 DEBUG [Listener at localhost/40369] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:47,150 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:47,151 DEBUG [Listener at localhost/40369] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 15:01:47,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:47,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:47,251 DEBUG [Listener at localhost/40369] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 15:01:47,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 15:01:47,256 INFO [Listener at localhost/40369] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676732506564 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:47,256 DEBUG [Listener at localhost/40369] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40941/user/jenkins/test-data/f333d5bc-dafe-0437-359e-0c6fbdaf6a53/foo/c629c2ce-4557-46ff-a5d4-395eb9f8974f/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,256 INFO [Listener at localhost/40369] snapshot.RestoreSnapshotHelper(239): region to add: 17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:47,256 INFO [Listener at localhost/40369] snapshot.RestoreSnapshotHelper(585): clone region=17b32e9f6e3aa131a260418717721bef as 17b32e9f6e3aa131a260418717721bef in snapshot foo 2023-02-18 15:01:47,257 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 17b32e9f6e3aa131a260418717721bef, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40941/user/jenkins/test-data/f333d5bc-dafe-0437-359e-0c6fbdaf6a53/foo/c629c2ce-4557-46ff-a5d4-395eb9f8974f 2023-02-18 15:01:47,263 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:47,263 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c5f4d05534c54665bfff6c529bc2196b from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,265 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 642534ef53dc4550b306c4874b8c5533 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,267 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 17b32e9f6e3aa131a260418717721bef, disabling compactions & flushes 2023-02-18 15:01:47,267 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:47,267 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:47,267 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. after waiting 0 ms 2023-02-18 15:01:47,267 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:47,267 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:47,267 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 17b32e9f6e3aa131a260418717721bef: 2023-02-18 15:01:47,268 INFO [Listener at localhost/40369] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676732506564 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:47,269 DEBUG [Listener at localhost/40369] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40941/user/jenkins/test-data/f333d5bc-dafe-0437-359e-0c6fbdaf6a53/foo/c629c2ce-4557-46ff-a5d4-395eb9f8974f 2023-02-18 15:01:47,269 DEBUG [Listener at localhost/40369] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40941/user/jenkins/test-data/f333d5bc-dafe-0437-359e-0c6fbdaf6a53/foo/c629c2ce-4557-46ff-a5d4-395eb9f8974f 2023-02-18 15:01:47,269 DEBUG [Listener at localhost/40369] util.CommonFSUtils(699): |-data/ 2023-02-18 15:01:47,269 DEBUG [Listener at localhost/40369] util.CommonFSUtils(699): |----default/ 2023-02-18 15:01:47,270 DEBUG [Listener at localhost/40369] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-18 15:01:47,270 DEBUG [Listener at localhost/40369] util.CommonFSUtils(699): |----------17b32e9f6e3aa131a260418717721bef/ 2023-02-18 15:01:47,270 DEBUG [Listener at localhost/40369] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:47,270 DEBUG [Listener at localhost/40369] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:47,271 DEBUG [Listener at localhost/40369] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=17b32e9f6e3aa131a260418717721bef-c5f4d05534c54665bfff6c529bc2196b 2023-02-18 15:01:47,271 DEBUG [Listener at localhost/40369] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:47,271 DEBUG [Listener at localhost/40369] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=17b32e9f6e3aa131a260418717721bef-642534ef53dc4550b306c4874b8c5533 hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/02348e14bd8144a287f11a5b26d43f74 hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/c5f4d05534c54665bfff6c529bc2196b hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/642534ef53dc4550b306c4874b8c5533 hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/6536ee76215e45f8b88ca3d16e8d2971 2023-02-18 15:01:47,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-18 15:01:47,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-18 15:01:47,280 INFO [Listener at localhost/40369] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:47,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732507284"}]},"ts":"1676732507284"} 2023-02-18 15:01:47,285 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-18 15:01:47,287 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-18 15:01:47,287 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=17b32e9f6e3aa131a260418717721bef, UNASSIGN}] 2023-02-18 15:01:47,293 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=17b32e9f6e3aa131a260418717721bef, UNASSIGN 2023-02-18 15:01:47,294 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=17b32e9f6e3aa131a260418717721bef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,294 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676732507294"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732507294"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732507294"}]},"ts":"1676732507294"} 2023-02-18 15:01:47,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 17b32e9f6e3aa131a260418717721bef, server=jenkins-hbase4.apache.org,33607,1676732504804}] 2023-02-18 15:01:47,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:47,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:47,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 17b32e9f6e3aa131a260418717721bef, disabling compactions & flushes 2023-02-18 15:01:47,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:47,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:47,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. after waiting 0 ms 2023-02-18 15:01:47,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:47,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:47,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef. 2023-02-18 15:01:47,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 17b32e9f6e3aa131a260418717721bef: 2023-02-18 15:01:47,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:47,458 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=17b32e9f6e3aa131a260418717721bef, regionState=CLOSED 2023-02-18 15:01:47,458 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676732507458"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732507458"}]},"ts":"1676732507458"} 2023-02-18 15:01:47,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 15:01:47,461 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 17b32e9f6e3aa131a260418717721bef, server=jenkins-hbase4.apache.org,33607,1676732504804 in 164 msec 2023-02-18 15:01:47,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 15:01:47,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=17b32e9f6e3aa131a260418717721bef, UNASSIGN in 174 msec 2023-02-18 15:01:47,462 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732507462"}]},"ts":"1676732507462"} 2023-02-18 15:01:47,464 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-18 15:01:47,466 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-18 15:01:47,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 187 msec 2023-02-18 15:01:47,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:47,587 INFO [Listener at localhost/40369] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-18 15:01:47,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,590 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,591 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 15:01:47,593 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:47,595 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1, FileablePath, hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2, FileablePath, hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/recovered.edits] 2023-02-18 15:01:47,597 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/02348e14bd8144a287f11a5b26d43f74 to hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/02348e14bd8144a287f11a5b26d43f74 2023-02-18 15:01:47,598 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/c5f4d05534c54665bfff6c529bc2196b to hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f1/c5f4d05534c54665bfff6c529bc2196b 2023-02-18 15:01:47,601 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/642534ef53dc4550b306c4874b8c5533 to hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/642534ef53dc4550b306c4874b8c5533 2023-02-18 15:01:47,602 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/6536ee76215e45f8b88ca3d16e8d2971 to hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/f2/6536ee76215e45f8b88ca3d16e8d2971 2023-02-18 15:01:47,605 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/recovered.edits/12.seqid to hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef/recovered.edits/12.seqid 2023-02-18 15:01:47,605 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/17b32e9f6e3aa131a260418717721bef 2023-02-18 15:01:47,605 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-18 15:01:47,608 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,609 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-18 15:01:47,611 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-18 15:01:47,615 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,615 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-18 15:01:47,615 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732507615"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:47,616 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 15:01:47,616 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 17b32e9f6e3aa131a260418717721bef, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676732505842.17b32e9f6e3aa131a260418717721bef.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 15:01:47,616 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-18 15:01:47,617 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676732507616"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:47,618 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-18 15:01:47,620 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 15:01:47,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 32 msec 2023-02-18 15:01:47,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 15:01:47,693 INFO [Listener at localhost/40369] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-18 15:01:47,693 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 15:01:47,693 INFO [Listener at localhost/40369] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 15:01:47,693 DEBUG [Listener at localhost/40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4862dfc3 to 127.0.0.1:64821 2023-02-18 15:01:47,693 DEBUG [Listener at localhost/40369] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:47,694 DEBUG [Listener at localhost/40369] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 15:01:47,694 DEBUG [Listener at localhost/40369] util.JVMClusterUtil(257): Found active master hash=851267673, stopped=false 2023-02-18 15:01:47,694 INFO [Listener at localhost/40369] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42503,1676732504729 2023-02-18 15:01:47,695 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:47,695 INFO [Listener at localhost/40369] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 15:01:47,695 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:47,695 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:47,695 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:47,697 DEBUG [Listener at localhost/40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09c3c466 to 127.0.0.1:64821 2023-02-18 15:01:47,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:47,697 DEBUG [Listener at localhost/40369] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:47,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:47,697 INFO [Listener at localhost/40369] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36433,1676732504780' ***** 2023-02-18 15:01:47,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:47,698 INFO [Listener at localhost/40369] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:47,698 INFO [Listener at localhost/40369] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33607,1676732504804' ***** 2023-02-18 15:01:47,698 INFO [Listener at localhost/40369] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:47,698 INFO [RS:0;jenkins-hbase4:36433] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:47,698 INFO [RS:1;jenkins-hbase4:33607] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:47,698 INFO [RS:0;jenkins-hbase4:36433] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:47,698 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:47,698 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:47,698 INFO [RS:0;jenkins-hbase4:36433] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:47,698 INFO [RS:1;jenkins-hbase4:33607] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:47,700 INFO [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(3304): Received CLOSE for 4ca3e06fe1909437747f3ec26f8aee42 2023-02-18 15:01:47,700 INFO [RS:1;jenkins-hbase4:33607] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:47,700 INFO [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,700 DEBUG [RS:1;jenkins-hbase4:33607] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19e95656 to 127.0.0.1:64821 2023-02-18 15:01:47,700 DEBUG [RS:1;jenkins-hbase4:33607] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:47,700 INFO [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:47,700 INFO [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33607,1676732504804; all regions closed. 2023-02-18 15:01:47,700 DEBUG [RS:0;jenkins-hbase4:36433] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43cf695a to 127.0.0.1:64821 2023-02-18 15:01:47,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4ca3e06fe1909437747f3ec26f8aee42, disabling compactions & flushes 2023-02-18 15:01:47,700 DEBUG [RS:0;jenkins-hbase4:36433] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:47,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:47,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:47,701 INFO [RS:0;jenkins-hbase4:36433] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:47,701 INFO [RS:0;jenkins-hbase4:36433] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:47,701 INFO [RS:0;jenkins-hbase4:36433] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:47,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. after waiting 0 ms 2023-02-18 15:01:47,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:47,701 INFO [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 15:01:47,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4ca3e06fe1909437747f3ec26f8aee42 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 15:01:47,701 INFO [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-18 15:01:47,701 DEBUG [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1479): Online Regions={4ca3e06fe1909437747f3ec26f8aee42=hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42., 1588230740=hbase:meta,,1.1588230740} 2023-02-18 15:01:47,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:47,701 DEBUG [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1505): Waiting on 1588230740, 4ca3e06fe1909437747f3ec26f8aee42 2023-02-18 15:01:47,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:47,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:47,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:47,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:47,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-18 15:01:47,704 DEBUG [RS:1;jenkins-hbase4:33607] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/oldWALs 2023-02-18 15:01:47,705 INFO [RS:1;jenkins-hbase4:33607] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33607%2C1676732504804:(num 1676732506100) 2023-02-18 15:01:47,705 DEBUG [RS:1;jenkins-hbase4:33607] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:47,705 INFO [RS:1;jenkins-hbase4:33607] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:47,705 INFO [RS:1;jenkins-hbase4:33607] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:47,705 INFO [RS:1;jenkins-hbase4:33607] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:47,705 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:47,705 INFO [RS:1;jenkins-hbase4:33607] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:47,705 INFO [RS:1;jenkins-hbase4:33607] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:47,706 INFO [RS:1;jenkins-hbase4:33607] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33607 2023-02-18 15:01:47,712 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/.tmp/info/f3fcc29de61f4a9dbd1c7712982afdab 2023-02-18 15:01:47,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42/.tmp/info/fc039a46fe944008bbba6078118a21a2 2023-02-18 15:01:47,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3fcc29de61f4a9dbd1c7712982afdab 2023-02-18 15:01:47,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42/.tmp/info/fc039a46fe944008bbba6078118a21a2 as hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42/info/fc039a46fe944008bbba6078118a21a2 2023-02-18 15:01:47,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42/info/fc039a46fe944008bbba6078118a21a2, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 15:01:47,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4ca3e06fe1909437747f3ec26f8aee42 in 21ms, sequenceid=6, compaction requested=false 2023-02-18 15:01:47,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-18 15:01:47,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/.tmp/rep_barrier/c13f9dda00e0419d9941ae14282400e7 2023-02-18 15:01:47,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/namespace/4ca3e06fe1909437747f3ec26f8aee42/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 15:01:47,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:47,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4ca3e06fe1909437747f3ec26f8aee42: 2023-02-18 15:01:47,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676732505358.4ca3e06fe1909437747f3ec26f8aee42. 2023-02-18 15:01:47,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c13f9dda00e0419d9941ae14282400e7 2023-02-18 15:01:47,737 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/.tmp/table/2d9394401bbb4d4a9f9980d4c21e7784 2023-02-18 15:01:47,740 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d9394401bbb4d4a9f9980d4c21e7784 2023-02-18 15:01:47,741 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/.tmp/info/f3fcc29de61f4a9dbd1c7712982afdab as hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/info/f3fcc29de61f4a9dbd1c7712982afdab 2023-02-18 15:01:47,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3fcc29de61f4a9dbd1c7712982afdab 2023-02-18 15:01:47,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/info/f3fcc29de61f4a9dbd1c7712982afdab, entries=12, sequenceid=21, filesize=6.3 K 2023-02-18 15:01:47,745 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/.tmp/rep_barrier/c13f9dda00e0419d9941ae14282400e7 as hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/rep_barrier/c13f9dda00e0419d9941ae14282400e7 2023-02-18 15:01:47,748 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c13f9dda00e0419d9941ae14282400e7 2023-02-18 15:01:47,748 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/rep_barrier/c13f9dda00e0419d9941ae14282400e7, entries=1, sequenceid=21, filesize=5.1 K 2023-02-18 15:01:47,749 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/.tmp/table/2d9394401bbb4d4a9f9980d4c21e7784 as hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/table/2d9394401bbb4d4a9f9980d4c21e7784 2023-02-18 15:01:47,752 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d9394401bbb4d4a9f9980d4c21e7784 2023-02-18 15:01:47,752 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/table/2d9394401bbb4d4a9f9980d4c21e7784, entries=4, sequenceid=21, filesize=5.1 K 2023-02-18 15:01:47,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 52ms, sequenceid=21, compaction requested=false 2023-02-18 15:01:47,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-18 15:01:47,758 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 15:01:47,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 15:01:47,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:47,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:47,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:47,775 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:47,780 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:47,804 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:47,804 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,804 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33607,1676732504804 2023-02-18 15:01:47,805 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:47,805 ERROR [Listener at localhost/40369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13a26e33 rejected from java.util.concurrent.ThreadPoolExecutor@179de89f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:47,805 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:47,805 ERROR [Listener at localhost/40369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6354ef4f rejected from java.util.concurrent.ThreadPoolExecutor@179de89f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:47,805 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33607,1676732504804] 2023-02-18 15:01:47,805 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33607,1676732504804; numProcessing=1 2023-02-18 15:01:47,807 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33607,1676732504804 already deleted, retry=false 2023-02-18 15:01:47,807 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33607,1676732504804 expired; onlineServers=1 2023-02-18 15:01:47,901 INFO [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36433,1676732504780; all regions closed. 2023-02-18 15:01:47,905 DEBUG [RS:0;jenkins-hbase4:36433] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/oldWALs 2023-02-18 15:01:47,905 INFO [RS:0;jenkins-hbase4:36433] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36433%2C1676732504780.meta:.meta(num 1676732505305) 2023-02-18 15:01:47,908 DEBUG [RS:0;jenkins-hbase4:36433] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/oldWALs 2023-02-18 15:01:47,908 INFO [RS:0;jenkins-hbase4:36433] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36433%2C1676732504780:(num 1676732505697) 2023-02-18 15:01:47,908 DEBUG [RS:0;jenkins-hbase4:36433] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:47,908 INFO [RS:0;jenkins-hbase4:36433] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:47,908 INFO [RS:0;jenkins-hbase4:36433] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:47,908 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:47,909 INFO [RS:0;jenkins-hbase4:36433] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36433 2023-02-18 15:01:47,911 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36433,1676732504780 2023-02-18 15:01:47,911 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:47,911 ERROR [Listener at localhost/40369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@405e1a87 rejected from java.util.concurrent.ThreadPoolExecutor@44619654[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:47,912 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36433,1676732504780] 2023-02-18 15:01:47,912 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36433,1676732504780; numProcessing=2 2023-02-18 15:01:47,913 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36433,1676732504780 already deleted, retry=false 2023-02-18 15:01:47,913 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36433,1676732504780 expired; onlineServers=0 2023-02-18 15:01:47,913 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42503,1676732504729' ***** 2023-02-18 15:01:47,913 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 15:01:47,914 DEBUG [M:0;jenkins-hbase4:42503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3682c2d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:47,914 INFO [M:0;jenkins-hbase4:42503] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42503,1676732504729 2023-02-18 15:01:47,914 INFO [M:0;jenkins-hbase4:42503] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42503,1676732504729; all regions closed. 2023-02-18 15:01:47,914 DEBUG [M:0;jenkins-hbase4:42503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:47,914 DEBUG [M:0;jenkins-hbase4:42503] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 15:01:47,914 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 15:01:47,914 DEBUG [M:0;jenkins-hbase4:42503] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 15:01:47,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732504961] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732504961,5,FailOnTimeoutGroup] 2023-02-18 15:01:47,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732504961] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732504961,5,FailOnTimeoutGroup] 2023-02-18 15:01:47,914 INFO [M:0;jenkins-hbase4:42503] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 15:01:47,915 INFO [M:0;jenkins-hbase4:42503] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 15:01:47,916 INFO [M:0;jenkins-hbase4:42503] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 15:01:47,916 DEBUG [M:0;jenkins-hbase4:42503] master.HMaster(1512): Stopping service threads 2023-02-18 15:01:47,916 INFO [M:0;jenkins-hbase4:42503] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 15:01:47,916 ERROR [M:0;jenkins-hbase4:42503] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 15:01:47,916 INFO [M:0;jenkins-hbase4:42503] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 15:01:47,916 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 15:01:47,918 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:47,918 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:47,918 DEBUG [M:0;jenkins-hbase4:42503] zookeeper.ZKUtil(398): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 15:01:47,918 WARN [M:0;jenkins-hbase4:42503] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 15:01:47,919 INFO [M:0;jenkins-hbase4:42503] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 15:01:47,919 INFO [M:0;jenkins-hbase4:42503] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 15:01:47,919 DEBUG [M:0;jenkins-hbase4:42503] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:47,919 INFO [M:0;jenkins-hbase4:42503] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:47,919 DEBUG [M:0;jenkins-hbase4:42503] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:47,919 DEBUG [M:0;jenkins-hbase4:42503] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:47,919 DEBUG [M:0;jenkins-hbase4:42503] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:47,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:47,919 INFO [M:0;jenkins-hbase4:42503] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.67 KB heapSize=67.66 KB 2023-02-18 15:01:47,930 INFO [M:0;jenkins-hbase4:42503] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6e097091b1fa4a4fb2bdadb33d583b65 2023-02-18 15:01:47,934 DEBUG [M:0;jenkins-hbase4:42503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6e097091b1fa4a4fb2bdadb33d583b65 as hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6e097091b1fa4a4fb2bdadb33d583b65 2023-02-18 15:01:47,937 INFO [M:0;jenkins-hbase4:42503] regionserver.HStore(1080): Added hdfs://localhost:40941/user/jenkins/test-data/0ceb9208-bbb0-75e1-1c01-172d75bba941/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6e097091b1fa4a4fb2bdadb33d583b65, entries=17, sequenceid=132, filesize=8.7 K 2023-02-18 15:01:47,938 INFO [M:0;jenkins-hbase4:42503] regionserver.HRegion(2947): Finished flush of dataSize ~56.67 KB/58031, heapSize ~67.64 KB/69264, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-18 15:01:47,938 INFO [M:0;jenkins-hbase4:42503] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:47,938 DEBUG [M:0;jenkins-hbase4:42503] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:47,940 INFO [M:0;jenkins-hbase4:42503] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 15:01:47,940 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:47,941 INFO [M:0;jenkins-hbase4:42503] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42503 2023-02-18 15:01:47,942 DEBUG [M:0;jenkins-hbase4:42503] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42503,1676732504729 already deleted, retry=false 2023-02-18 15:01:48,095 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:48,096 INFO [M:0;jenkins-hbase4:42503] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42503,1676732504729; zookeeper connection closed. 2023-02-18 15:01:48,096 ERROR [Listener at localhost/40369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d5d849e rejected from java.util.concurrent.ThreadPoolExecutor@79620fed[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:48,097 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): master:42503-0x10067f3844b0000, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:48,097 ERROR [Listener at localhost/40369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cfebb38 rejected from java.util.concurrent.ThreadPoolExecutor@79620fed[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:48,196 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:48,196 INFO [RS:0;jenkins-hbase4:36433] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36433,1676732504780; zookeeper connection closed. 2023-02-18 15:01:48,196 ERROR [Listener at localhost/40369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12bd69 rejected from java.util.concurrent.ThreadPoolExecutor@44619654[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:48,196 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:36433-0x10067f3844b0001, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:48,196 ERROR [Listener at localhost/40369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78b3e6a9 rejected from java.util.concurrent.ThreadPoolExecutor@44619654[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:48,196 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@666bd66] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@666bd66 2023-02-18 15:01:48,296 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:48,296 INFO [RS:1;jenkins-hbase4:33607] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33607,1676732504804; zookeeper connection closed. 2023-02-18 15:01:48,296 ERROR [Listener at localhost/40369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ba6031f rejected from java.util.concurrent.ThreadPoolExecutor@179de89f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:48,297 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5d84b2f3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5d84b2f3 2023-02-18 15:01:48,297 DEBUG [Listener at localhost/40369-EventThread] zookeeper.ZKWatcher(600): regionserver:33607-0x10067f3844b0002, quorum=127.0.0.1:64821, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:48,297 ERROR [Listener at localhost/40369-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@76da34c9 rejected from java.util.concurrent.ThreadPoolExecutor@179de89f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:48,297 INFO [Listener at localhost/40369] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 15:01:48,297 WARN [Listener at localhost/40369] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:48,310 INFO [Listener at localhost/40369] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:48,314 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 15:01:48,404 WARN [BP-621185919-172.31.14.131-1676732504162 heartbeating to localhost/127.0.0.1:40941] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:48,404 WARN [BP-621185919-172.31.14.131-1676732504162 heartbeating to localhost/127.0.0.1:40941] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-621185919-172.31.14.131-1676732504162 (Datanode Uuid 3260b8dd-4cef-4fc6-af31-f780aa1e4516) service to localhost/127.0.0.1:40941 2023-02-18 15:01:48,404 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/cluster_eb1a7933-129c-0f45-51df-0562ef6b8221/dfs/data/data3/current/BP-621185919-172.31.14.131-1676732504162] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:48,405 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/cluster_eb1a7933-129c-0f45-51df-0562ef6b8221/dfs/data/data4/current/BP-621185919-172.31.14.131-1676732504162] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:48,407 WARN [Listener at localhost/40369] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:48,438 INFO [Listener at localhost/40369] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:48,541 WARN [BP-621185919-172.31.14.131-1676732504162 heartbeating to localhost/127.0.0.1:40941] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:48,541 WARN [BP-621185919-172.31.14.131-1676732504162 heartbeating to localhost/127.0.0.1:40941] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-621185919-172.31.14.131-1676732504162 (Datanode Uuid ec291ec3-4277-4568-9d28-17d5c80f8cf1) service to localhost/127.0.0.1:40941 2023-02-18 15:01:48,542 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/cluster_eb1a7933-129c-0f45-51df-0562ef6b8221/dfs/data/data1/current/BP-621185919-172.31.14.131-1676732504162] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:48,543 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/cluster_eb1a7933-129c-0f45-51df-0562ef6b8221/dfs/data/data2/current/BP-621185919-172.31.14.131-1676732504162] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:48,562 INFO [Listener at localhost/40369] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:48,677 INFO [Listener at localhost/40369] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 15:01:48,696 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 15:01:48,711 INFO [Listener at localhost/40369] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=273 (was 252) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40941 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40941 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,42503,1676732504729)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40941 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:40941 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40369 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:40941 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40941 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40941 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=571 (was 660), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=342 (was 363), ProcessCount=171 (was 171), AvailableMemoryMB=8521 (was 8571) 2023-02-18 15:01:48,724 INFO [Listener at localhost/40369] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=273, OpenFileDescriptor=571, MaxFileDescriptor=60000, SystemLoadAverage=342, ProcessCount=171, AvailableMemoryMB=8520 2023-02-18 15:01:48,735 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/hadoop.log.dir so I do NOT create it in target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d 2023-02-18 15:01:48,735 WARN [Listener at localhost/40369] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 15:01:48,735 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/hadoop.tmp.dir so I do NOT create it in target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d 2023-02-18 15:01:48,735 WARN [Listener at localhost/40369] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bde4f7e8-9921-4cf6-83e9-70cafcc4246e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 15:01:48,735 DEBUG [Listener at localhost/40369] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d 2023-02-18 15:01:48,735 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 15:01:48,736 INFO [Listener at localhost/40369] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/cluster_7b3762fa-ab87-2406-dcf6-4c35c795d3ad, deleteOnExit=true 2023-02-18 15:01:48,736 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 15:01:48,736 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/test.cache.data in system properties and HBase conf 2023-02-18 15:01:48,736 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 15:01:48,736 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/hadoop.log.dir in system properties and HBase conf 2023-02-18 15:01:48,736 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 15:01:48,737 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 15:01:48,737 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 15:01:48,737 DEBUG [Listener at localhost/40369] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 15:01:48,737 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:48,737 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 15:01:48,737 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 15:01:48,738 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:48,738 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 15:01:48,738 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 15:01:48,738 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 15:01:48,738 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:48,738 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 15:01:48,738 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/nfs.dump.dir in system properties and HBase conf 2023-02-18 15:01:48,738 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/java.io.tmpdir in system properties and HBase conf 2023-02-18 15:01:48,738 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 15:01:48,739 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 15:01:48,739 INFO [Listener at localhost/40369] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 15:01:48,743 WARN [Listener at localhost/40369] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:48,744 WARN [Listener at localhost/40369] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:48,788 WARN [Listener at localhost/40369] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:48,790 INFO [Listener at localhost/40369] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:48,795 INFO [Listener at localhost/40369] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/java.io.tmpdir/Jetty_localhost_41579_hdfs____wi6z8k/webapp 2023-02-18 15:01:48,886 INFO [Listener at localhost/40369] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41579 2023-02-18 15:01:48,891 WARN [Listener at localhost/40369] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 15:01:48,891 WARN [Listener at localhost/40369] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 15:01:48,932 WARN [Listener at localhost/32797] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:48,951 WARN [Listener at localhost/32797] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:48,953 WARN [Listener at localhost/32797] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:48,954 INFO [Listener at localhost/32797] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:48,960 INFO [Listener at localhost/32797] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/java.io.tmpdir/Jetty_localhost_40855_datanode____4gus3n/webapp 2023-02-18 15:01:49,051 INFO [Listener at localhost/32797] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40855 2023-02-18 15:01:49,060 WARN [Listener at localhost/42561] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:49,078 WARN [Listener at localhost/42561] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 15:01:49,080 WARN [Listener at localhost/42561] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 15:01:49,081 INFO [Listener at localhost/42561] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 15:01:49,087 INFO [Listener at localhost/42561] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/java.io.tmpdir/Jetty_localhost_38511_datanode____ynqhrr/webapp 2023-02-18 15:01:49,176 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf26c2be77391b3a5: Processing first storage report for DS-52c23865-b6c6-4718-b26f-983e6b0700cc from datanode 95c7cca4-9633-4674-858c-0b5477aa1053 2023-02-18 15:01:49,176 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf26c2be77391b3a5: from storage DS-52c23865-b6c6-4718-b26f-983e6b0700cc node DatanodeRegistration(127.0.0.1:45091, datanodeUuid=95c7cca4-9633-4674-858c-0b5477aa1053, infoPort=34303, infoSecurePort=0, ipcPort=42561, storageInfo=lv=-57;cid=testClusterID;nsid=1958633154;c=1676732508746), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:49,176 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf26c2be77391b3a5: Processing first storage report for DS-a4cc40dd-895d-48a6-88ce-f3fadf6fa31a from datanode 95c7cca4-9633-4674-858c-0b5477aa1053 2023-02-18 15:01:49,176 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf26c2be77391b3a5: from storage DS-a4cc40dd-895d-48a6-88ce-f3fadf6fa31a node DatanodeRegistration(127.0.0.1:45091, datanodeUuid=95c7cca4-9633-4674-858c-0b5477aa1053, infoPort=34303, infoSecurePort=0, ipcPort=42561, storageInfo=lv=-57;cid=testClusterID;nsid=1958633154;c=1676732508746), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:49,201 INFO [Listener at localhost/42561] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38511 2023-02-18 15:01:49,213 WARN [Listener at localhost/43957] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 15:01:49,302 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1f3838beb7ab0b4f: Processing first storage report for DS-dd69fd41-5735-4fa1-95a2-da407402c6f0 from datanode 08316784-82f4-441d-bb88-448130619af4 2023-02-18 15:01:49,303 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1f3838beb7ab0b4f: from storage DS-dd69fd41-5735-4fa1-95a2-da407402c6f0 node DatanodeRegistration(127.0.0.1:46881, datanodeUuid=08316784-82f4-441d-bb88-448130619af4, infoPort=38749, infoSecurePort=0, ipcPort=43957, storageInfo=lv=-57;cid=testClusterID;nsid=1958633154;c=1676732508746), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 15:01:49,303 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1f3838beb7ab0b4f: Processing first storage report for DS-9ef60540-0076-4575-8d7b-706b22e70a3a from datanode 08316784-82f4-441d-bb88-448130619af4 2023-02-18 15:01:49,303 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1f3838beb7ab0b4f: from storage DS-9ef60540-0076-4575-8d7b-706b22e70a3a node DatanodeRegistration(127.0.0.1:46881, datanodeUuid=08316784-82f4-441d-bb88-448130619af4, infoPort=38749, infoSecurePort=0, ipcPort=43957, storageInfo=lv=-57;cid=testClusterID;nsid=1958633154;c=1676732508746), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 15:01:49,320 DEBUG [Listener at localhost/43957] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d 2023-02-18 15:01:49,322 INFO [Listener at localhost/43957] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/cluster_7b3762fa-ab87-2406-dcf6-4c35c795d3ad/zookeeper_0, clientPort=62548, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/cluster_7b3762fa-ab87-2406-dcf6-4c35c795d3ad/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/cluster_7b3762fa-ab87-2406-dcf6-4c35c795d3ad/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 15:01:49,323 INFO [Listener at localhost/43957] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62548 2023-02-18 15:01:49,323 INFO [Listener at localhost/43957] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:49,324 INFO [Listener at localhost/43957] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:49,334 INFO [Listener at localhost/43957] util.FSUtils(479): Created version file at hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c with version=8 2023-02-18 15:01:49,335 INFO [Listener at localhost/43957] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:49,336 INFO [Listener at localhost/43957] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:49,337 INFO [Listener at localhost/43957] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:32797/user/jenkins/test-data/cf1f43d0-be61-39df-7377-9caead842d3b/hbase-staging 2023-02-18 15:01:49,338 INFO [Listener at localhost/43957] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:49,339 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:49,339 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:49,339 INFO [Listener at localhost/43957] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:49,339 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:49,339 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:49,339 INFO [Listener at localhost/43957] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:49,340 INFO [Listener at localhost/43957] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33955 2023-02-18 15:01:49,340 INFO [Listener at localhost/43957] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:49,341 INFO [Listener at localhost/43957] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:49,342 INFO [Listener at localhost/43957] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33955 connecting to ZooKeeper ensemble=127.0.0.1:62548 2023-02-18 15:01:49,349 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:339550x0, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:49,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33955-0x10067f3964f0000 connected 2023-02-18 15:01:49,366 DEBUG [Listener at localhost/43957] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:49,367 DEBUG [Listener at localhost/43957] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:49,367 DEBUG [Listener at localhost/43957] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:49,367 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33955 2023-02-18 15:01:49,367 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33955 2023-02-18 15:01:49,368 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33955 2023-02-18 15:01:49,368 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33955 2023-02-18 15:01:49,368 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33955 2023-02-18 15:01:49,368 INFO [Listener at localhost/43957] master.HMaster(444): hbase.rootdir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c, hbase.cluster.distributed=false 2023-02-18 15:01:49,380 INFO [Listener at localhost/43957] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:49,380 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:49,381 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:49,381 INFO [Listener at localhost/43957] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:49,381 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:49,381 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:49,381 INFO [Listener at localhost/43957] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:49,382 INFO [Listener at localhost/43957] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36949 2023-02-18 15:01:49,382 INFO [Listener at localhost/43957] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:49,382 DEBUG [Listener at localhost/43957] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:49,383 INFO [Listener at localhost/43957] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:49,383 INFO [Listener at localhost/43957] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:49,384 INFO [Listener at localhost/43957] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36949 connecting to ZooKeeper ensemble=127.0.0.1:62548 2023-02-18 15:01:49,386 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:369490x0, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:49,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36949-0x10067f3964f0001 connected 2023-02-18 15:01:49,389 DEBUG [Listener at localhost/43957] zookeeper.ZKUtil(164): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:49,389 DEBUG [Listener at localhost/43957] zookeeper.ZKUtil(164): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:49,390 DEBUG [Listener at localhost/43957] zookeeper.ZKUtil(164): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:49,390 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36949 2023-02-18 15:01:49,390 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36949 2023-02-18 15:01:49,391 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36949 2023-02-18 15:01:49,391 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36949 2023-02-18 15:01:49,391 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36949 2023-02-18 15:01:49,401 INFO [Listener at localhost/43957] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 15:01:49,402 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:49,402 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:49,402 INFO [Listener at localhost/43957] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 15:01:49,402 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 15:01:49,402 INFO [Listener at localhost/43957] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 15:01:49,402 INFO [Listener at localhost/43957] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 15:01:49,403 INFO [Listener at localhost/43957] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41325 2023-02-18 15:01:49,403 INFO [Listener at localhost/43957] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 15:01:49,403 DEBUG [Listener at localhost/43957] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:49,403 INFO [Listener at localhost/43957] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:49,404 INFO [Listener at localhost/43957] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:49,405 INFO [Listener at localhost/43957] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41325 connecting to ZooKeeper ensemble=127.0.0.1:62548 2023-02-18 15:01:49,407 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:413250x0, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 15:01:49,407 DEBUG [Listener at localhost/43957] zookeeper.ZKUtil(164): regionserver:413250x0, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:49,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41325-0x10067f3964f0002 connected 2023-02-18 15:01:49,408 DEBUG [Listener at localhost/43957] zookeeper.ZKUtil(164): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:49,409 DEBUG [Listener at localhost/43957] zookeeper.ZKUtil(164): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 15:01:49,409 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41325 2023-02-18 15:01:49,409 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41325 2023-02-18 15:01:49,409 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41325 2023-02-18 15:01:49,410 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41325 2023-02-18 15:01:49,410 DEBUG [Listener at localhost/43957] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41325 2023-02-18 15:01:49,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33955,1676732509338 2023-02-18 15:01:49,413 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:49,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33955,1676732509338 2023-02-18 15:01:49,415 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:49,415 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:49,415 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:49,415 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:49,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:49,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33955,1676732509338 from backup master directory 2023-02-18 15:01:49,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 15:01:49,422 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33955,1676732509338 2023-02-18 15:01:49,422 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 15:01:49,422 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:49,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33955,1676732509338 2023-02-18 15:01:49,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/hbase.id with ID: 16bc6920-3649-40be-95e3-4485219dcce9 2023-02-18 15:01:49,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 15:01:49,442 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:49,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2164dc3a to 127.0.0.1:62548 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:49,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ddcf78f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:49,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:49,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 15:01:49,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:49,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/data/master/store-tmp 2023-02-18 15:01:49,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:49,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:49,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:49,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:49,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:49,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:49,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:49,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:49,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/WALs/jenkins-hbase4.apache.org,33955,1676732509338 2023-02-18 15:01:49,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33955%2C1676732509338, suffix=, logDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/WALs/jenkins-hbase4.apache.org,33955,1676732509338, archiveDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/oldWALs, maxLogs=10 2023-02-18 15:01:49,473 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45091,DS-52c23865-b6c6-4718-b26f-983e6b0700cc,DISK] 2023-02-18 15:01:49,473 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46881,DS-dd69fd41-5735-4fa1-95a2-da407402c6f0,DISK] 2023-02-18 15:01:49,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/WALs/jenkins-hbase4.apache.org,33955,1676732509338/jenkins-hbase4.apache.org%2C33955%2C1676732509338.1676732509461 2023-02-18 15:01:49,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45091,DS-52c23865-b6c6-4718-b26f-983e6b0700cc,DISK], DatanodeInfoWithStorage[127.0.0.1:46881,DS-dd69fd41-5735-4fa1-95a2-da407402c6f0,DISK]] 2023-02-18 15:01:49,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:49,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:49,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:49,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:49,476 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:49,477 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 15:01:49,477 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 15:01:49,478 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:49,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:49,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:49,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 15:01:49,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:49,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71132475, jitterRate=0.05995647609233856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:49,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:49,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 15:01:49,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 15:01:49,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 15:01:49,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 15:01:49,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 15:01:49,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 15:01:49,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 15:01:49,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 15:01:49,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 15:01:49,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 15:01:49,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 15:01:49,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 15:01:49,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 15:01:49,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 15:01:49,498 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:49,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 15:01:49,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 15:01:49,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 15:01:49,500 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:49,500 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:49,500 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:49,500 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:49,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33955,1676732509338, sessionid=0x10067f3964f0000, setting cluster-up flag (Was=false) 2023-02-18 15:01:49,506 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:49,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 15:01:49,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33955,1676732509338 2023-02-18 15:01:49,513 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:49,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 15:01:49,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33955,1676732509338 2023-02-18 15:01:49,519 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.hbase-snapshot/.tmp 2023-02-18 15:01:49,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:49,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:49,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:49,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:49,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 15:01:49,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 15:01:49,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:49,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676732539522 2023-02-18 15:01:49,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 15:01:49,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 15:01:49,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 15:01:49,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 15:01:49,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 15:01:49,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 15:01:49,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,523 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:49,523 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 15:01:49,524 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:49,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 15:01:49,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 15:01:49,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 15:01:49,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 15:01:49,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 15:01:49,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732509525,5,FailOnTimeoutGroup] 2023-02-18 15:01:49,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732509525,5,FailOnTimeoutGroup] 2023-02-18 15:01:49,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 15:01:49,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,531 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:49,531 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:49,531 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c 2023-02-18 15:01:49,536 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:49,537 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:49,537 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/info 2023-02-18 15:01:49,538 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:49,538 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:49,538 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:49,539 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:49,539 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:49,539 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:49,539 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:49,540 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/table 2023-02-18 15:01:49,540 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:49,540 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:49,541 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740 2023-02-18 15:01:49,541 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740 2023-02-18 15:01:49,542 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:49,543 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:49,544 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:49,544 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72279163, jitterRate=0.07704345881938934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:49,544 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:49,544 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:49,544 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:49,544 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:49,544 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:49,545 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:49,545 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:49,545 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:49,545 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 15:01:49,545 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 15:01:49,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 15:01:49,546 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 15:01:49,547 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 15:01:49,612 INFO [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer(952): ClusterId : 16bc6920-3649-40be-95e3-4485219dcce9 2023-02-18 15:01:49,612 INFO [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(952): ClusterId : 16bc6920-3649-40be-95e3-4485219dcce9 2023-02-18 15:01:49,612 DEBUG [RS:0;jenkins-hbase4:36949] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:49,612 DEBUG [RS:1;jenkins-hbase4:41325] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 15:01:49,615 DEBUG [RS:0;jenkins-hbase4:36949] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:49,615 DEBUG [RS:0;jenkins-hbase4:36949] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:49,615 DEBUG [RS:1;jenkins-hbase4:41325] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 15:01:49,615 DEBUG [RS:1;jenkins-hbase4:41325] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 15:01:49,619 DEBUG [RS:0;jenkins-hbase4:36949] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:49,620 DEBUG [RS:1;jenkins-hbase4:41325] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 15:01:49,621 DEBUG [RS:0;jenkins-hbase4:36949] zookeeper.ReadOnlyZKClient(139): Connect 0x4dc258fb to 127.0.0.1:62548 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:49,621 DEBUG [RS:1;jenkins-hbase4:41325] zookeeper.ReadOnlyZKClient(139): Connect 0x2592947a to 127.0.0.1:62548 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:49,624 DEBUG [RS:0;jenkins-hbase4:36949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4305af33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:49,624 DEBUG [RS:1;jenkins-hbase4:41325] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b557eb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:49,624 DEBUG [RS:0;jenkins-hbase4:36949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@473a338b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:49,624 DEBUG [RS:1;jenkins-hbase4:41325] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f6aff0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:49,633 DEBUG [RS:0;jenkins-hbase4:36949] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36949 2023-02-18 15:01:49,633 DEBUG [RS:1;jenkins-hbase4:41325] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41325 2023-02-18 15:01:49,633 INFO [RS:0;jenkins-hbase4:36949] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:49,633 INFO [RS:0;jenkins-hbase4:36949] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:49,633 INFO [RS:1;jenkins-hbase4:41325] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 15:01:49,633 INFO [RS:1;jenkins-hbase4:41325] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 15:01:49,633 DEBUG [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:49,633 DEBUG [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 15:01:49,634 INFO [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33955,1676732509338 with isa=jenkins-hbase4.apache.org/172.31.14.131:36949, startcode=1676732509380 2023-02-18 15:01:49,634 INFO [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33955,1676732509338 with isa=jenkins-hbase4.apache.org/172.31.14.131:41325, startcode=1676732509401 2023-02-18 15:01:49,634 DEBUG [RS:0;jenkins-hbase4:36949] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:49,634 DEBUG [RS:1;jenkins-hbase4:41325] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 15:01:49,635 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44507, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:49,636 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58329, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 15:01:49,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33955] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:49,637 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:49,638 DEBUG [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c 2023-02-18 15:01:49,638 DEBUG [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32797 2023-02-18 15:01:49,638 DEBUG [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:49,638 DEBUG [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c 2023-02-18 15:01:49,638 DEBUG [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32797 2023-02-18 15:01:49,638 DEBUG [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 15:01:49,639 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:49,644 DEBUG [RS:0;jenkins-hbase4:36949] zookeeper.ZKUtil(162): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:49,644 WARN [RS:0;jenkins-hbase4:36949] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:49,644 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41325,1676732509401] 2023-02-18 15:01:49,644 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36949,1676732509380] 2023-02-18 15:01:49,644 INFO [RS:0;jenkins-hbase4:36949] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:49,644 DEBUG [RS:1;jenkins-hbase4:41325] zookeeper.ZKUtil(162): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:49,644 DEBUG [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/WALs/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:49,644 WARN [RS:1;jenkins-hbase4:41325] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 15:01:49,644 INFO [RS:1;jenkins-hbase4:41325] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:49,644 DEBUG [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/WALs/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:49,651 DEBUG [RS:0;jenkins-hbase4:36949] zookeeper.ZKUtil(162): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:49,651 DEBUG [RS:1;jenkins-hbase4:41325] zookeeper.ZKUtil(162): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:49,651 DEBUG [RS:0;jenkins-hbase4:36949] zookeeper.ZKUtil(162): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:49,651 DEBUG [RS:1;jenkins-hbase4:41325] zookeeper.ZKUtil(162): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:49,652 DEBUG [RS:0;jenkins-hbase4:36949] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:49,652 DEBUG [RS:1;jenkins-hbase4:41325] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 15:01:49,652 INFO [RS:0;jenkins-hbase4:36949] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:49,652 INFO [RS:1;jenkins-hbase4:41325] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 15:01:49,653 INFO [RS:0;jenkins-hbase4:36949] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:49,653 INFO [RS:0;jenkins-hbase4:36949] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:49,653 INFO [RS:0;jenkins-hbase4:36949] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,653 INFO [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:49,656 INFO [RS:1;jenkins-hbase4:41325] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 15:01:49,657 INFO [RS:1;jenkins-hbase4:41325] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 15:01:49,657 INFO [RS:0;jenkins-hbase4:36949] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,657 INFO [RS:1;jenkins-hbase4:41325] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,657 DEBUG [RS:0;jenkins-hbase4:36949] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,657 DEBUG [RS:0;jenkins-hbase4:36949] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,657 DEBUG [RS:0;jenkins-hbase4:36949] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,657 INFO [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 15:01:49,657 DEBUG [RS:0;jenkins-hbase4:36949] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,658 DEBUG [RS:0;jenkins-hbase4:36949] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,658 DEBUG [RS:0;jenkins-hbase4:36949] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:49,658 DEBUG [RS:0;jenkins-hbase4:36949] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,658 DEBUG [RS:0;jenkins-hbase4:36949] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,658 DEBUG [RS:0;jenkins-hbase4:36949] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,658 DEBUG [RS:0;jenkins-hbase4:36949] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,660 INFO [RS:0;jenkins-hbase4:36949] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,660 INFO [RS:1;jenkins-hbase4:41325] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,660 INFO [RS:0;jenkins-hbase4:36949] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,660 DEBUG [RS:1;jenkins-hbase4:41325] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,660 INFO [RS:0;jenkins-hbase4:36949] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,660 DEBUG [RS:1;jenkins-hbase4:41325] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,660 DEBUG [RS:1;jenkins-hbase4:41325] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,660 DEBUG [RS:1;jenkins-hbase4:41325] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,660 DEBUG [RS:1;jenkins-hbase4:41325] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,660 DEBUG [RS:1;jenkins-hbase4:41325] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 15:01:49,660 DEBUG [RS:1;jenkins-hbase4:41325] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,660 DEBUG [RS:1;jenkins-hbase4:41325] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,660 DEBUG [RS:1;jenkins-hbase4:41325] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,660 DEBUG [RS:1;jenkins-hbase4:41325] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 15:01:49,664 INFO [RS:1;jenkins-hbase4:41325] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,664 INFO [RS:1;jenkins-hbase4:41325] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,664 INFO [RS:1;jenkins-hbase4:41325] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,675 INFO [RS:0;jenkins-hbase4:36949] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:49,675 INFO [RS:0;jenkins-hbase4:36949] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36949,1676732509380-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,680 INFO [RS:1;jenkins-hbase4:41325] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 15:01:49,680 INFO [RS:1;jenkins-hbase4:41325] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41325,1676732509401-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,691 INFO [RS:0;jenkins-hbase4:36949] regionserver.Replication(203): jenkins-hbase4.apache.org,36949,1676732509380 started 2023-02-18 15:01:49,691 INFO [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36949,1676732509380, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36949, sessionid=0x10067f3964f0001 2023-02-18 15:01:49,691 DEBUG [RS:0;jenkins-hbase4:36949] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:49,691 DEBUG [RS:0;jenkins-hbase4:36949] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:49,691 DEBUG [RS:0;jenkins-hbase4:36949] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36949,1676732509380' 2023-02-18 15:01:49,691 DEBUG [RS:0;jenkins-hbase4:36949] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:49,692 DEBUG [RS:0;jenkins-hbase4:36949] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:49,692 DEBUG [RS:0;jenkins-hbase4:36949] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:49,692 DEBUG [RS:0;jenkins-hbase4:36949] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:49,692 DEBUG [RS:0;jenkins-hbase4:36949] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:49,692 DEBUG [RS:0;jenkins-hbase4:36949] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36949,1676732509380' 2023-02-18 15:01:49,692 DEBUG [RS:0;jenkins-hbase4:36949] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:49,693 DEBUG [RS:0;jenkins-hbase4:36949] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:49,693 DEBUG [RS:0;jenkins-hbase4:36949] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:49,693 INFO [RS:0;jenkins-hbase4:36949] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:49,693 INFO [RS:0;jenkins-hbase4:36949] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:49,694 INFO [RS:1;jenkins-hbase4:41325] regionserver.Replication(203): jenkins-hbase4.apache.org,41325,1676732509401 started 2023-02-18 15:01:49,694 INFO [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41325,1676732509401, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41325, sessionid=0x10067f3964f0002 2023-02-18 15:01:49,694 DEBUG [RS:1;jenkins-hbase4:41325] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 15:01:49,694 DEBUG [RS:1;jenkins-hbase4:41325] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:49,694 DEBUG [RS:1;jenkins-hbase4:41325] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41325,1676732509401' 2023-02-18 15:01:49,694 DEBUG [RS:1;jenkins-hbase4:41325] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:49,695 DEBUG [RS:1;jenkins-hbase4:41325] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:49,695 DEBUG [RS:1;jenkins-hbase4:41325] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 15:01:49,695 DEBUG [RS:1;jenkins-hbase4:41325] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 15:01:49,695 DEBUG [RS:1;jenkins-hbase4:41325] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:49,695 DEBUG [RS:1;jenkins-hbase4:41325] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41325,1676732509401' 2023-02-18 15:01:49,695 DEBUG [RS:1;jenkins-hbase4:41325] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:49,695 DEBUG [RS:1;jenkins-hbase4:41325] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:49,695 DEBUG [RS:1;jenkins-hbase4:41325] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 15:01:49,695 INFO [RS:1;jenkins-hbase4:41325] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 15:01:49,695 INFO [RS:1;jenkins-hbase4:41325] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 15:01:49,697 DEBUG [jenkins-hbase4:33955] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 15:01:49,698 DEBUG [jenkins-hbase4:33955] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:49,699 DEBUG [jenkins-hbase4:33955] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:49,699 DEBUG [jenkins-hbase4:33955] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:49,699 DEBUG [jenkins-hbase4:33955] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:49,699 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41325,1676732509401, state=OPENING 2023-02-18 15:01:49,700 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 15:01:49,701 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:49,701 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:49,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41325,1676732509401}] 2023-02-18 15:01:49,855 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:49,856 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:49,857 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53676, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:49,861 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 15:01:49,861 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 15:01:49,862 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41325%2C1676732509401.meta, suffix=.meta, logDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/WALs/jenkins-hbase4.apache.org,41325,1676732509401, archiveDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/oldWALs, maxLogs=32 2023-02-18 15:01:49,877 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45091,DS-52c23865-b6c6-4718-b26f-983e6b0700cc,DISK] 2023-02-18 15:01:49,877 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46881,DS-dd69fd41-5735-4fa1-95a2-da407402c6f0,DISK] 2023-02-18 15:01:49,879 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/WALs/jenkins-hbase4.apache.org,41325,1676732509401/jenkins-hbase4.apache.org%2C41325%2C1676732509401.meta.1676732509862.meta 2023-02-18 15:01:49,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46881,DS-dd69fd41-5735-4fa1-95a2-da407402c6f0,DISK], DatanodeInfoWithStorage[127.0.0.1:45091,DS-52c23865-b6c6-4718-b26f-983e6b0700cc,DISK]] 2023-02-18 15:01:49,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:49,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 15:01:49,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 15:01:49,880 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 15:01:49,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 15:01:49,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:49,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 15:01:49,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 15:01:49,881 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 15:01:49,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/info 2023-02-18 15:01:49,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/info 2023-02-18 15:01:49,882 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 15:01:49,882 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:49,883 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 15:01:49,883 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:49,883 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/rep_barrier 2023-02-18 15:01:49,883 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 15:01:49,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:49,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 15:01:49,885 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/table 2023-02-18 15:01:49,885 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/table 2023-02-18 15:01:49,885 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 15:01:49,886 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:49,886 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740 2023-02-18 15:01:49,887 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740 2023-02-18 15:01:49,890 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 15:01:49,891 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 15:01:49,892 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66301570, jitterRate=-0.01202961802482605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 15:01:49,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 15:01:49,893 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676732509855 2023-02-18 15:01:49,896 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 15:01:49,898 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 15:01:49,899 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41325,1676732509401, state=OPEN 2023-02-18 15:01:49,900 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 15:01:49,900 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 15:01:49,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 15:01:49,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41325,1676732509401 in 199 msec 2023-02-18 15:01:49,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 15:01:49,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-18 15:01:49,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 383 msec 2023-02-18 15:01:49,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676732509904, completionTime=-1 2023-02-18 15:01:49,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 15:01:49,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 15:01:49,906 DEBUG [hconnection-0x26c0b921-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:49,907 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53688, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:49,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 15:01:49,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676732569908 2023-02-18 15:01:49,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676732629908 2023-02-18 15:01:49,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-18 15:01:49,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33955,1676732509338-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33955,1676732509338-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33955,1676732509338-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33955, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 15:01:49,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 15:01:49,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:49,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 15:01:49,919 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 15:01:49,919 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:49,920 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:49,921 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80 2023-02-18 15:01:49,921 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80 empty. 2023-02-18 15:01:49,922 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80 2023-02-18 15:01:49,923 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 15:01:49,938 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:49,945 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 14e38e219a88ee77a3cbf9f34489da80, NAME => 'hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp 2023-02-18 15:01:49,964 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:49,965 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 14e38e219a88ee77a3cbf9f34489da80, disabling compactions & flushes 2023-02-18 15:01:49,965 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:49,965 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:49,965 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. after waiting 0 ms 2023-02-18 15:01:49,965 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:49,965 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:49,965 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 14e38e219a88ee77a3cbf9f34489da80: 2023-02-18 15:01:49,967 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:49,969 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732509969"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732509969"}]},"ts":"1676732509969"} 2023-02-18 15:01:49,970 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 15:01:49,971 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:49,971 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732509971"}]},"ts":"1676732509971"} 2023-02-18 15:01:49,972 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 15:01:49,975 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:49,975 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:49,975 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:49,975 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:49,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=14e38e219a88ee77a3cbf9f34489da80, ASSIGN}] 2023-02-18 15:01:49,978 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=14e38e219a88ee77a3cbf9f34489da80, ASSIGN 2023-02-18 15:01:49,978 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=14e38e219a88ee77a3cbf9f34489da80, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41325,1676732509401; forceNewPlan=false, retain=false 2023-02-18 15:01:50,128 INFO [jenkins-hbase4:33955] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 15:01:50,129 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=14e38e219a88ee77a3cbf9f34489da80, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:50,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732510129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732510129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732510129"}]},"ts":"1676732510129"} 2023-02-18 15:01:50,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 14e38e219a88ee77a3cbf9f34489da80, server=jenkins-hbase4.apache.org,41325,1676732509401}] 2023-02-18 15:01:50,285 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:50,286 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41325%2C1676732509401, suffix=, logDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/WALs/jenkins-hbase4.apache.org,41325,1676732509401, archiveDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/oldWALs, maxLogs=32 2023-02-18 15:01:50,301 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46881,DS-dd69fd41-5735-4fa1-95a2-da407402c6f0,DISK] 2023-02-18 15:01:50,302 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45091,DS-52c23865-b6c6-4718-b26f-983e6b0700cc,DISK] 2023-02-18 15:01:50,304 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/WALs/jenkins-hbase4.apache.org,41325,1676732509401/jenkins-hbase4.apache.org%2C41325%2C1676732509401.1676732510286 2023-02-18 15:01:50,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46881,DS-dd69fd41-5735-4fa1-95a2-da407402c6f0,DISK], DatanodeInfoWithStorage[127.0.0.1:45091,DS-52c23865-b6c6-4718-b26f-983e6b0700cc,DISK]] 2023-02-18 15:01:50,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 14e38e219a88ee77a3cbf9f34489da80, NAME => 'hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:50,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 14e38e219a88ee77a3cbf9f34489da80 2023-02-18 15:01:50,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:50,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 14e38e219a88ee77a3cbf9f34489da80 2023-02-18 15:01:50,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 14e38e219a88ee77a3cbf9f34489da80 2023-02-18 15:01:50,306 INFO [StoreOpener-14e38e219a88ee77a3cbf9f34489da80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 14e38e219a88ee77a3cbf9f34489da80 2023-02-18 15:01:50,307 DEBUG [StoreOpener-14e38e219a88ee77a3cbf9f34489da80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80/info 2023-02-18 15:01:50,307 DEBUG [StoreOpener-14e38e219a88ee77a3cbf9f34489da80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80/info 2023-02-18 15:01:50,308 INFO [StoreOpener-14e38e219a88ee77a3cbf9f34489da80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14e38e219a88ee77a3cbf9f34489da80 columnFamilyName info 2023-02-18 15:01:50,308 INFO [StoreOpener-14e38e219a88ee77a3cbf9f34489da80-1] regionserver.HStore(310): Store=14e38e219a88ee77a3cbf9f34489da80/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:50,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80 2023-02-18 15:01:50,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80 2023-02-18 15:01:50,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 14e38e219a88ee77a3cbf9f34489da80 2023-02-18 15:01:50,312 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:50,312 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 14e38e219a88ee77a3cbf9f34489da80; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71197498, jitterRate=0.06092539429664612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 15:01:50,312 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 14e38e219a88ee77a3cbf9f34489da80: 2023-02-18 15:01:50,313 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80., pid=6, masterSystemTime=1676732510282 2023-02-18 15:01:50,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:50,315 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:50,316 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=14e38e219a88ee77a3cbf9f34489da80, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:50,316 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676732510315"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732510315"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732510315"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732510315"}]},"ts":"1676732510315"} 2023-02-18 15:01:50,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 15:01:50,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 14e38e219a88ee77a3cbf9f34489da80, server=jenkins-hbase4.apache.org,41325,1676732509401 in 187 msec 2023-02-18 15:01:50,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 15:01:50,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=14e38e219a88ee77a3cbf9f34489da80, ASSIGN in 342 msec 2023-02-18 15:01:50,319 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:50,319 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732510319"}]},"ts":"1676732510319"} 2023-02-18 15:01:50,320 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 15:01:50,324 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:50,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 407 msec 2023-02-18 15:01:50,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 15:01:50,420 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:50,420 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:50,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 15:01:50,429 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:50,431 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-18 15:01:50,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 15:01:50,441 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 15:01:50,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-18 15:01:50,448 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 15:01:50,450 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 15:01:50,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.028sec 2023-02-18 15:01:50,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 15:01:50,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 15:01:50,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 15:01:50,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33955,1676732509338-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 15:01:50,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33955,1676732509338-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 15:01:50,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 15:01:50,512 DEBUG [Listener at localhost/43957] zookeeper.ReadOnlyZKClient(139): Connect 0x70252428 to 127.0.0.1:62548 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:50,515 DEBUG [Listener at localhost/43957] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70719d95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:50,517 DEBUG [hconnection-0x3e44da6f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:50,518 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53698, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:50,520 INFO [Listener at localhost/43957] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33955,1676732509338 2023-02-18 15:01:50,520 DEBUG [Listener at localhost/43957] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 15:01:50,522 DEBUG [Listener at localhost/43957] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 15:01:50,523 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35618, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 15:01:50,524 INFO [Listener at localhost/43957] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 15:01:50,524 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-18 15:01:50,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 15:01:50,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:35618 deadline: 1676732570524, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-18 15:01:50,525 INFO [Listener at localhost/43957] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-18 15:01:50,527 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 15:01:50,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-18 15:01:50,529 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 15:01:50,529 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-18 15:01:50,530 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 15:01:50,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:50,531 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:50,532 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe empty. 2023-02-18 15:01:50,532 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:50,532 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 15:01:50,546 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-18 15:01:50,547 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0c907e0cb18709a0ba6e751cd41d8ebe, NAME => 'testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp 2023-02-18 15:01:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0c907e0cb18709a0ba6e751cd41d8ebe, disabling compactions & flushes 2023-02-18 15:01:50,553 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. after waiting 0 ms 2023-02-18 15:01:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:50,553 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0c907e0cb18709a0ba6e751cd41d8ebe: 2023-02-18 15:01:50,555 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 15:01:50,556 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676732510555"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732510555"}]},"ts":"1676732510555"} 2023-02-18 15:01:50,557 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 15:01:50,558 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 15:01:50,558 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732510558"}]},"ts":"1676732510558"} 2023-02-18 15:01:50,559 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-18 15:01:50,563 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 15:01:50,563 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 15:01:50,563 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 15:01:50,563 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 15:01:50,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0c907e0cb18709a0ba6e751cd41d8ebe, ASSIGN}] 2023-02-18 15:01:50,564 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0c907e0cb18709a0ba6e751cd41d8ebe, ASSIGN 2023-02-18 15:01:50,565 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0c907e0cb18709a0ba6e751cd41d8ebe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36949,1676732509380; forceNewPlan=false, retain=false 2023-02-18 15:01:50,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:50,694 INFO [RS:0;jenkins-hbase4:36949] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36949%2C1676732509380, suffix=, logDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/WALs/jenkins-hbase4.apache.org,36949,1676732509380, archiveDir=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/oldWALs, maxLogs=32 2023-02-18 15:01:50,709 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46881,DS-dd69fd41-5735-4fa1-95a2-da407402c6f0,DISK] 2023-02-18 15:01:50,709 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45091,DS-52c23865-b6c6-4718-b26f-983e6b0700cc,DISK] 2023-02-18 15:01:50,711 INFO [RS:0;jenkins-hbase4:36949] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/WALs/jenkins-hbase4.apache.org,36949,1676732509380/jenkins-hbase4.apache.org%2C36949%2C1676732509380.1676732510695 2023-02-18 15:01:50,711 DEBUG [RS:0;jenkins-hbase4:36949] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46881,DS-dd69fd41-5735-4fa1-95a2-da407402c6f0,DISK], DatanodeInfoWithStorage[127.0.0.1:45091,DS-52c23865-b6c6-4718-b26f-983e6b0700cc,DISK]] 2023-02-18 15:01:50,715 INFO [jenkins-hbase4:33955] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 15:01:50,715 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0c907e0cb18709a0ba6e751cd41d8ebe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:50,715 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676732510715"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732510715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732510715"}]},"ts":"1676732510715"} 2023-02-18 15:01:50,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 0c907e0cb18709a0ba6e751cd41d8ebe, server=jenkins-hbase4.apache.org,36949,1676732509380}] 2023-02-18 15:01:50,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:50,869 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:50,869 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 15:01:50,871 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51108, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 15:01:50,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:50,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0c907e0cb18709a0ba6e751cd41d8ebe, NAME => 'testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.', STARTKEY => '', ENDKEY => ''} 2023-02-18 15:01:50,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:50,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:50,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:50,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:50,875 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:50,876 DEBUG [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1 2023-02-18 15:01:50,876 DEBUG [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1 2023-02-18 15:01:50,876 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c907e0cb18709a0ba6e751cd41d8ebe columnFamilyName f1 2023-02-18 15:01:50,877 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] regionserver.HStore(310): Store=0c907e0cb18709a0ba6e751cd41d8ebe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:50,877 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:50,878 DEBUG [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2 2023-02-18 15:01:50,878 DEBUG [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2 2023-02-18 15:01:50,878 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c907e0cb18709a0ba6e751cd41d8ebe columnFamilyName f2 2023-02-18 15:01:50,878 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] regionserver.HStore(310): Store=0c907e0cb18709a0ba6e751cd41d8ebe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:50,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:50,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:50,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:50,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:50,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 15:01:50,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0c907e0cb18709a0ba6e751cd41d8ebe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73589631, jitterRate=0.0965709537267685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:50,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0c907e0cb18709a0ba6e751cd41d8ebe: 2023-02-18 15:01:50,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe., pid=12, masterSystemTime=1676732510869 2023-02-18 15:01:50,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:50,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:50,886 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0c907e0cb18709a0ba6e751cd41d8ebe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:50,886 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676732510886"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676732510886"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676732510886"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676732510886"}]},"ts":"1676732510886"} 2023-02-18 15:01:50,888 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 15:01:50,889 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 0c907e0cb18709a0ba6e751cd41d8ebe, server=jenkins-hbase4.apache.org,36949,1676732509380 in 171 msec 2023-02-18 15:01:50,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 15:01:50,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0c907e0cb18709a0ba6e751cd41d8ebe, ASSIGN in 325 msec 2023-02-18 15:01:50,890 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 15:01:50,891 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732510890"}]},"ts":"1676732510890"} 2023-02-18 15:01:50,892 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-18 15:01:50,894 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 15:01:50,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 367 msec 2023-02-18 15:01:51,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 15:01:51,134 INFO [Listener at localhost/43957] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-18 15:01:51,134 DEBUG [Listener at localhost/43957] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-18 15:01:51,135 INFO [Listener at localhost/43957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:51,136 INFO [Listener at localhost/43957] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-18 15:01:51,136 INFO [Listener at localhost/43957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 15:01:51,137 INFO [Listener at localhost/43957] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-18 15:01:51,137 INFO [Listener at localhost/43957] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 15:01:51,148 DEBUG [hconnection-0x3e44da6f-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:51,159 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51118, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:51,166 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36949] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:51,251 INFO [Listener at localhost/43957] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 15:01:51,252 INFO [Listener at localhost/43957] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 15:01:51,253 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 15:01:51,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676732511253 (current time:1676732511253). 2023-02-18 15:01:51,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 15:01:51,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] zookeeper.ReadOnlyZKClient(139): Connect 0x41192d5a to 127.0.0.1:62548 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 15:01:51,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@788c703f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 15:01:51,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 15:01:51,258 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53700, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 15:01:51,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41192d5a to 127.0.0.1:62548 2023-02-18 15:01:51,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:51,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 15:01:51,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 15:01:51,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 15:01:51,262 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 15:01:51,263 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676733111263 2023-02-18 15:01:51,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 15:01:51,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-18 15:01:51,266 DEBUG [Listener at localhost/43957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:51,266 DEBUG [Listener at localhost/43957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 15:01:51,266 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 15:01:51,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 15:01:51,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 6 msec 2023-02-18 15:01:51,267 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 15:01:51,268 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676733111268 2023-02-18 15:01:51,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-18 15:01:51,275 INFO [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-18 15:01:51,275 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:51,275 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-18 15:01:51,275 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-18 15:01:51,276 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,276 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 15:01:51,278 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:51,278 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:51,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:51,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:51,278 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 15:01:51,279 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,279 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 15:01:51,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-18 15:01:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 15:01:51,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-18 15:01:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-18 15:01:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 15:01:51,280 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-18 15:01:51,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-18 15:01:51,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-18 15:01:51,280 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-18 15:01:51,280 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:51,281 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-18 15:01:51,281 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 15:01:51,281 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-18 15:01:51,281 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 15:01:51,281 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41325,1676732509401' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-18 15:01:51,283 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 15:01:51,283 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-18 15:01:51,283 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36949,1676732509380' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-18 15:01:51,284 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,284 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,284 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:51,284 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,284 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:51,284 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,284 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 15:01:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:51,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36949,1676732509380' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-18 15:01:51,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@547b1952[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:51,286 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-18 15:01:51,286 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,287 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,287 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,287 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 15:01:51,287 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 15:01:51,287 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,287 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 15:01:51,287 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:51,287 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:51,287 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-18 15:01:51,287 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. started... 2023-02-18 15:01:51,287 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 15:01:51,287 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41325,1676732509401' in zk 2023-02-18 15:01:51,287 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0c907e0cb18709a0ba6e751cd41d8ebe 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 15:01:51,289 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-18 15:01:51,289 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:51,289 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-18 15:01:51,302 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/.tmp/f1/2b245e5eb9d14797b3eabcb267f0f77d 2023-02-18 15:01:51,318 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/.tmp/f2/9335aff1921a435cbffff9ec82972d5a 2023-02-18 15:01:51,321 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/.tmp/f1/2b245e5eb9d14797b3eabcb267f0f77d as hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1/2b245e5eb9d14797b3eabcb267f0f77d 2023-02-18 15:01:51,324 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1/2b245e5eb9d14797b3eabcb267f0f77d, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 15:01:51,325 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/.tmp/f2/9335aff1921a435cbffff9ec82972d5a as hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2/9335aff1921a435cbffff9ec82972d5a 2023-02-18 15:01:51,328 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2/9335aff1921a435cbffff9ec82972d5a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 15:01:51,329 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 0c907e0cb18709a0ba6e751cd41d8ebe in 42ms, sequenceid=5, compaction requested=false 2023-02-18 15:01:51,329 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0c907e0cb18709a0ba6e751cd41d8ebe: 2023-02-18 15:01:51,329 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-18 15:01:51,329 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 15:01:51,329 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1/2b245e5eb9d14797b3eabcb267f0f77d] hfiles 2023-02-18 15:01:51,329 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1/2b245e5eb9d14797b3eabcb267f0f77d for snapshot=testWithMapReduceSingleRegion 2023-02-18 15:01:51,329 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2/9335aff1921a435cbffff9ec82972d5a] hfiles 2023-02-18 15:01:51,329 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2/9335aff1921a435cbffff9ec82972d5a for snapshot=testWithMapReduceSingleRegion 2023-02-18 15:01:51,337 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. completed. 2023-02-18 15:01:51,337 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:51,337 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 15:01:51,338 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 15:01:51,338 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,338 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-18 15:01:51,338 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,36949,1676732509380' in zk 2023-02-18 15:01:51,340 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-18 15:01:51,340 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,340 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:51,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:51,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:51,340 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-18 15:01:51,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 15:01:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:51,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 15:01:51,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,36949,1676732509380': 2023-02-18 15:01:51,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36949,1676732509380' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-18 15:01:51,343 INFO [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-18 15:01:51,343 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:51,343 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:51,343 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-18 15:01:51,343 INFO [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 15:01:51,344 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,344 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:51,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 15:01:51,344 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:51,344 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,345 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:51,345 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:51,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 15:01:51,345 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 15:01:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,347 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:51,347 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 15:01:51,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,353 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,353 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 15:01:51,353 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:51,353 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:51,353 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-18 15:01:51,353 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 15:01:51,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-18 15:01:51,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:51,353 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:51,353 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 15:01:51,353 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:51,353 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,353 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 15:01:51,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 15:01:51,353 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 15:01:51,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:51,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:51,353 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-18 15:01:51,354 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 15:01:51,354 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 15:01:51,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 15:01:51,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 15:01:51,366 DEBUG [Listener at localhost/43957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:51,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:51,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 15:01:51,367 DEBUG [Listener at localhost/43957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 15:01:51,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-18 15:01:51,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-18 15:01:51,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-18 15:01:51,384 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-18 15:01:51,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676732511263Consolidate snapshot: testWithMapReduceSingleRegion at 1676732511353 (+90 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676732511353Writing data manifest for testWithMapReduceSingleRegion at 1676732511356 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676732511362 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676732511384 (+22 ms) 2023-02-18 15:01:51,384 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 15:01:51,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 119 msec 2023-02-18 15:01:51,568 DEBUG [Listener at localhost/43957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 15:01:51,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 15:01:51,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 15:01:51,569 INFO [Listener at localhost/43957] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 15:01:51,572 INFO [Listener at localhost/43957] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 15:01:51,577 INFO [Listener at localhost/43957] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 15:01:51,603 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36949] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:51,759 INFO [Listener at localhost/43957] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 15:01:51,763 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 15:01:51,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-18 15:01:51,765 INFO [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-18 15:01:51,765 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:51,765 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-18 15:01:51,765 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-18 15:01:51,765 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,765 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:51,767 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:51,767 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:51,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:51,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:51,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:51,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:51,767 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:51,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:51,767 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,767 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 15:01:51,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 15:01:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:51,768 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 15:01:51,768 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 15:01:51,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 15:01:51,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 15:01:51,768 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 15:01:51,768 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 15:01:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:51,768 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 15:01:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 15:01:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 15:01:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 15:01:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41325,1676732509401' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 15:01:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 15:01:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 15:01:51,769 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:51,769 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. started... 2023-02-18 15:01:51,769 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0c907e0cb18709a0ba6e751cd41d8ebe 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 15:01:51,770 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,770 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,770 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:51,783 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/.tmp/f1/a52632a125f74dfcbfb23e34391bf8da 2023-02-18 15:01:51,803 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/.tmp/f2/1f32440ecf7f4b3084ede29ce4fd84cd 2023-02-18 15:01:51,808 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/.tmp/f1/a52632a125f74dfcbfb23e34391bf8da as hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1/a52632a125f74dfcbfb23e34391bf8da 2023-02-18 15:01:51,812 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1/a52632a125f74dfcbfb23e34391bf8da, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 15:01:51,812 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/.tmp/f2/1f32440ecf7f4b3084ede29ce4fd84cd as hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2/1f32440ecf7f4b3084ede29ce4fd84cd 2023-02-18 15:01:51,817 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2/1f32440ecf7f4b3084ede29ce4fd84cd, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 15:01:51,817 INFO [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 0c907e0cb18709a0ba6e751cd41d8ebe in 48ms, sequenceid=9, compaction requested=false 2023-02-18 15:01:51,817 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0c907e0cb18709a0ba6e751cd41d8ebe: 2023-02-18 15:01:51,817 DEBUG [rs(jenkins-hbase4.apache.org,36949,1676732509380)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:51,818 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 15:01:51,818 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 15:01:51,818 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,818 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 15:01:51,818 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36949,1676732509380' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 15:01:51,821 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,821 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:51,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:51,821 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,821 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 15:01:51,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:51,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:51,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:51,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:51,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36949,1676732509380' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 15:01:51,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50448705[Count = 0] remaining members to acquire global barrier 2023-02-18 15:01:51,823 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-18 15:01:51,823 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,824 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,824 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,824 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 15:01:51,824 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 15:01:51,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,824 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36949,1676732509380' in zk 2023-02-18 15:01:51,824 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 15:01:51,824 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 15:01:51,825 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41325,1676732509401' in zk 2023-02-18 15:01:51,824 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,825 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 15:01:51,826 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 15:01:51,826 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,826 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:51,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,826 DEBUG [member: 'jenkins-hbase4.apache.org,36949,1676732509380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 15:01:51,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:51,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:51,826 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 15:01:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:51,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,41325,1676732509401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 15:01:51,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:51,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:51,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:51,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:51,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,36949,1676732509380': 2023-02-18 15:01:51,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36949,1676732509380' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-18 15:01:51,829 INFO [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-18 15:01:51,829 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 15:01:51,829 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 15:01:51,829 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-18 15:01:51,829 INFO [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 15:01:51,832 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,832 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:51,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,832 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,832 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 15:01:51,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 15:01:51,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,832 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:51,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:51,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:51,833 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:51,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 15:01:51,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:51,833 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:51,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 15:01:51,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:51,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,835 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,836 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 15:01:51,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 15:01:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 15:01:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:51,838 DEBUG [(jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 15:01:51,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 15:01:51,839 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-18 15:01:51,839 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 15:01:51,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 15:01:51,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-18 15:01:51,838 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 15:01:51,839 DEBUG [Listener at localhost/43957] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-18 15:01:51,839 DEBUG [Listener at localhost/43957] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 15:01:51,839 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 15:01:51,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 15:01:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 15:01:51,939 DEBUG [Listener at localhost/43957] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 15:01:51,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 15:01:52,031 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/hadoop-1257911094241418540.jar 2023-02-18 15:01:52,034 INFO [Listener at localhost/43957] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676732511253 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:52,034 DEBUG [Listener at localhost/43957] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:32797/user/jenkins/test-data/cf1f43d0-be61-39df-7377-9caead842d3b/testWithMapReduceSingleRegion/1b0278f5-7182-4fbf-a81f-ecf77c7e8b07/data/default/testWithMapReduce 2023-02-18 15:01:52,035 INFO [Listener at localhost/43957] snapshot.RestoreSnapshotHelper(239): region to add: 0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:52,035 INFO [Listener at localhost/43957] snapshot.RestoreSnapshotHelper(585): clone region=0c907e0cb18709a0ba6e751cd41d8ebe as 0c907e0cb18709a0ba6e751cd41d8ebe in snapshot testWithMapReduceSingleRegion 2023-02-18 15:01:52,036 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0c907e0cb18709a0ba6e751cd41d8ebe, NAME => 'testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32797/user/jenkins/test-data/cf1f43d0-be61-39df-7377-9caead842d3b/testWithMapReduceSingleRegion/1b0278f5-7182-4fbf-a81f-ecf77c7e8b07 2023-02-18 15:01:52,041 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:52,041 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2b245e5eb9d14797b3eabcb267f0f77d from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-18 15:01:52,043 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9335aff1921a435cbffff9ec82972d5a from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-18 15:01:52,045 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0c907e0cb18709a0ba6e751cd41d8ebe, disabling compactions & flushes 2023-02-18 15:01:52,045 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:52,045 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:52,045 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. after waiting 0 ms 2023-02-18 15:01:52,045 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:52,045 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:52,045 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0c907e0cb18709a0ba6e751cd41d8ebe: 2023-02-18 15:01:52,045 INFO [Listener at localhost/43957] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676732511253 type: FLUSH version: 2 ttl: 0 2023-02-18 15:01:52,045 DEBUG [Listener at localhost/43957] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:32797/user/jenkins/test-data/cf1f43d0-be61-39df-7377-9caead842d3b/testWithMapReduceSingleRegion/1b0278f5-7182-4fbf-a81f-ecf77c7e8b07 2023-02-18 15:01:52,045 DEBUG [Listener at localhost/43957] util.CommonFSUtils(682): File system contents for path hdfs://localhost:32797/user/jenkins/test-data/cf1f43d0-be61-39df-7377-9caead842d3b/testWithMapReduceSingleRegion/1b0278f5-7182-4fbf-a81f-ecf77c7e8b07 2023-02-18 15:01:52,046 DEBUG [Listener at localhost/43957] util.CommonFSUtils(699): |-data/ 2023-02-18 15:01:52,046 DEBUG [Listener at localhost/43957] util.CommonFSUtils(699): |----default/ 2023-02-18 15:01:52,046 DEBUG [Listener at localhost/43957] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-18 15:01:52,047 DEBUG [Listener at localhost/43957] util.CommonFSUtils(699): |----------0c907e0cb18709a0ba6e751cd41d8ebe/ 2023-02-18 15:01:52,047 DEBUG [Listener at localhost/43957] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 15:01:52,047 DEBUG [Listener at localhost/43957] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 15:01:52,047 DEBUG [Listener at localhost/43957] util.CommonFSUtils(702): |----------------testWithMapReduce=0c907e0cb18709a0ba6e751cd41d8ebe-2b245e5eb9d14797b3eabcb267f0f77d 2023-02-18 15:01:52,047 DEBUG [Listener at localhost/43957] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 15:01:52,048 DEBUG [Listener at localhost/43957] util.CommonFSUtils(702): |----------------testWithMapReduce=0c907e0cb18709a0ba6e751cd41d8ebe-9335aff1921a435cbffff9ec82972d5a 2023-02-18 15:01:52,048 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:52,048 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:52,049 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:52,049 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:52,990 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/hadoop-9107231914449244709.jar 2023-02-18 15:01:52,991 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:52,991 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:53,072 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/hadoop-9044657011741377061.jar 2023-02-18 15:01:53,073 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:53,074 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:53,074 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:53,075 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:53,076 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:53,076 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:53,077 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-18 15:01:53,077 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-18 15:01:53,078 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-18 15:01:53,078 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-18 15:01:53,079 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-18 15:01:53,080 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-18 15:01:53,080 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-18 15:01:53,081 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-18 15:01:53,081 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-18 15:01:53,082 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-18 15:01:53,083 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 15:01:53,083 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 15:01:53,084 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 15:01:53,084 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 15:01:53,085 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 15:01:53,170 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/hadoop-3548640348279255818.jar 2023-02-18 15:01:53,171 DEBUG [Listener at localhost/43957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 15:01:53,177 WARN [Listener at localhost/43957] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-18 15:01:53,184 WARN [Listener at localhost/43957] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-18 15:01:53,192 INFO [Listener at localhost/43957] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 15:01:53,231 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 15:01:53,326 WARN [Listener at localhost/43957] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/mapreduce.cluster.local.dir/1676732513248/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-18 15:01:53,326 WARN [Listener at localhost/43957] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/mapreduce.cluster.local.dir/1676732513248/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-18 15:01:53,381 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 15:01:53,381 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 15:01:53,382 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 15:01:53,384 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:53,385 DEBUG [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/cf1f43d0-be61-39df-7377-9caead842d3b/testWithMapReduceSingleRegion/1b0278f5-7182-4fbf-a81f-ecf77c7e8b07/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1 2023-02-18 15:01:53,386 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c907e0cb18709a0ba6e751cd41d8ebe columnFamilyName f1 2023-02-18 15:01:53,391 DEBUG [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] regionserver.HStore(539): loaded hdfs://localhost:32797/user/jenkins/test-data/cf1f43d0-be61-39df-7377-9caead842d3b/testWithMapReduceSingleRegion/1b0278f5-7182-4fbf-a81f-ecf77c7e8b07/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1/testWithMapReduce=0c907e0cb18709a0ba6e751cd41d8ebe-2b245e5eb9d14797b3eabcb267f0f77d 2023-02-18 15:01:53,391 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] regionserver.HStore(310): Store=0c907e0cb18709a0ba6e751cd41d8ebe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:53,391 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:53,392 DEBUG [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32797/user/jenkins/test-data/cf1f43d0-be61-39df-7377-9caead842d3b/testWithMapReduceSingleRegion/1b0278f5-7182-4fbf-a81f-ecf77c7e8b07/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2 2023-02-18 15:01:53,392 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c907e0cb18709a0ba6e751cd41d8ebe columnFamilyName f2 2023-02-18 15:01:53,400 DEBUG [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] regionserver.HStore(539): loaded hdfs://localhost:32797/user/jenkins/test-data/cf1f43d0-be61-39df-7377-9caead842d3b/testWithMapReduceSingleRegion/1b0278f5-7182-4fbf-a81f-ecf77c7e8b07/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2/testWithMapReduce=0c907e0cb18709a0ba6e751cd41d8ebe-9335aff1921a435cbffff9ec82972d5a 2023-02-18 15:01:53,400 INFO [StoreOpener-0c907e0cb18709a0ba6e751cd41d8ebe-1] regionserver.HStore(310): Store=0c907e0cb18709a0ba6e751cd41d8ebe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 15:01:53,400 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 15:01:53,400 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0c907e0cb18709a0ba6e751cd41d8ebe; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69321530, jitterRate=0.03297129273414612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 15:01:53,400 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0c907e0cb18709a0ba6e751cd41d8ebe: 2023-02-18 15:01:53,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0c907e0cb18709a0ba6e751cd41d8ebe, disabling compactions & flushes 2023-02-18 15:01:53,624 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:53,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:53,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. after waiting 0 ms 2023-02-18 15:01:53,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:53,625 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:53,625 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0c907e0cb18709a0ba6e751cd41d8ebe: 2023-02-18 15:01:54,379 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-18 15:01:54,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-18 15:01:54,382 INFO [Listener at localhost/43957] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 15:01:54,383 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-18 15:01:54,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-18 15:01:54,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:54,386 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732514386"}]},"ts":"1676732514386"} 2023-02-18 15:01:54,387 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-18 15:01:54,389 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-18 15:01:54,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0c907e0cb18709a0ba6e751cd41d8ebe, UNASSIGN}] 2023-02-18 15:01:54,390 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0c907e0cb18709a0ba6e751cd41d8ebe, UNASSIGN 2023-02-18 15:01:54,391 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0c907e0cb18709a0ba6e751cd41d8ebe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:54,391 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676732514391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676732514391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676732514391"}]},"ts":"1676732514391"} 2023-02-18 15:01:54,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 0c907e0cb18709a0ba6e751cd41d8ebe, server=jenkins-hbase4.apache.org,36949,1676732509380}] 2023-02-18 15:01:54,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:54,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:54,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0c907e0cb18709a0ba6e751cd41d8ebe, disabling compactions & flushes 2023-02-18 15:01:54,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:54,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:54,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. after waiting 0 ms 2023-02-18 15:01:54,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:54,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 15:01:54,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe. 2023-02-18 15:01:54,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0c907e0cb18709a0ba6e751cd41d8ebe: 2023-02-18 15:01:54,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:54,551 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0c907e0cb18709a0ba6e751cd41d8ebe, regionState=CLOSED 2023-02-18 15:01:54,551 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676732514551"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676732514551"}]},"ts":"1676732514551"} 2023-02-18 15:01:54,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 15:01:54,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 0c907e0cb18709a0ba6e751cd41d8ebe, server=jenkins-hbase4.apache.org,36949,1676732509380 in 160 msec 2023-02-18 15:01:54,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 15:01:54,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0c907e0cb18709a0ba6e751cd41d8ebe, UNASSIGN in 163 msec 2023-02-18 15:01:54,555 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676732514554"}]},"ts":"1676732514554"} 2023-02-18 15:01:54,555 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-18 15:01:54,558 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-18 15:01:54,559 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 175 msec 2023-02-18 15:01:54,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 15:01:54,688 INFO [Listener at localhost/43957] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-18 15:01:54,689 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-18 15:01:54,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:54,692 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:54,692 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:54,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 15:01:54,695 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:54,696 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1, FileablePath, hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2, FileablePath, hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/recovered.edits] 2023-02-18 15:01:54,699 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1/2b245e5eb9d14797b3eabcb267f0f77d to hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/archive/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1/2b245e5eb9d14797b3eabcb267f0f77d 2023-02-18 15:01:54,700 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1/a52632a125f74dfcbfb23e34391bf8da to hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/archive/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f1/a52632a125f74dfcbfb23e34391bf8da 2023-02-18 15:01:54,702 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2/1f32440ecf7f4b3084ede29ce4fd84cd to hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/archive/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2/1f32440ecf7f4b3084ede29ce4fd84cd 2023-02-18 15:01:54,703 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2/9335aff1921a435cbffff9ec82972d5a to hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/archive/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/f2/9335aff1921a435cbffff9ec82972d5a 2023-02-18 15:01:54,705 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/recovered.edits/12.seqid to hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/archive/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe/recovered.edits/12.seqid 2023-02-18 15:01:54,706 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/.tmp/data/default/testWithMapReduce/0c907e0cb18709a0ba6e751cd41d8ebe 2023-02-18 15:01:54,706 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 15:01:54,707 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:54,709 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-18 15:01:54,710 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-18 15:01:54,711 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:54,711 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-18 15:01:54,711 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676732514711"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:54,713 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 15:01:54,713 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0c907e0cb18709a0ba6e751cd41d8ebe, NAME => 'testWithMapReduce,,1676732510527.0c907e0cb18709a0ba6e751cd41d8ebe.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 15:01:54,713 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-18 15:01:54,713 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676732514713"}]},"ts":"9223372036854775807"} 2023-02-18 15:01:54,714 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-18 15:01:54,716 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 15:01:54,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 27 msec 2023-02-18 15:01:54,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 15:01:54,794 INFO [Listener at localhost/43957] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-18 15:01:54,794 INFO [Listener at localhost/43957] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 15:01:54,794 INFO [Listener at localhost/43957] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 15:01:54,794 DEBUG [Listener at localhost/43957] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70252428 to 127.0.0.1:62548 2023-02-18 15:01:54,794 DEBUG [Listener at localhost/43957] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:54,795 DEBUG [Listener at localhost/43957] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 15:01:54,795 DEBUG [Listener at localhost/43957] util.JVMClusterUtil(257): Found active master hash=1712540634, stopped=false 2023-02-18 15:01:54,795 INFO [Listener at localhost/43957] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33955,1676732509338 2023-02-18 15:01:54,797 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:54,797 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:54,797 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:54,797 INFO [Listener at localhost/43957] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 15:01:54,797 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 15:01:54,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:54,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:54,799 DEBUG [Listener at localhost/43957] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2164dc3a to 127.0.0.1:62548 2023-02-18 15:01:54,799 DEBUG [Listener at localhost/43957] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:54,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 15:01:54,799 INFO [Listener at localhost/43957] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36949,1676732509380' ***** 2023-02-18 15:01:54,799 INFO [Listener at localhost/43957] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:54,799 INFO [Listener at localhost/43957] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41325,1676732509401' ***** 2023-02-18 15:01:54,799 INFO [Listener at localhost/43957] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 15:01:54,799 INFO [RS:0;jenkins-hbase4:36949] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:54,800 INFO [RS:0;jenkins-hbase4:36949] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:54,800 INFO [RS:1;jenkins-hbase4:41325] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 15:01:54,800 INFO [RS:0;jenkins-hbase4:36949] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:54,800 INFO [RS:1;jenkins-hbase4:41325] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 15:01:54,800 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:54,800 INFO [RS:1;jenkins-hbase4:41325] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 15:01:54,800 INFO [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:54,801 INFO [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(3304): Received CLOSE for 14e38e219a88ee77a3cbf9f34489da80 2023-02-18 15:01:54,800 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 15:01:54,801 DEBUG [RS:0;jenkins-hbase4:36949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dc258fb to 127.0.0.1:62548 2023-02-18 15:01:54,801 DEBUG [RS:0;jenkins-hbase4:36949] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:54,802 INFO [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:54,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 14e38e219a88ee77a3cbf9f34489da80, disabling compactions & flushes 2023-02-18 15:01:54,802 INFO [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36949,1676732509380; all regions closed. 2023-02-18 15:01:54,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:54,802 DEBUG [RS:1;jenkins-hbase4:41325] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2592947a to 127.0.0.1:62548 2023-02-18 15:01:54,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:54,802 DEBUG [RS:1;jenkins-hbase4:41325] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:54,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. after waiting 0 ms 2023-02-18 15:01:54,802 INFO [RS:1;jenkins-hbase4:41325] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:54,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:54,802 INFO [RS:1;jenkins-hbase4:41325] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:54,802 INFO [RS:1;jenkins-hbase4:41325] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:54,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 14e38e219a88ee77a3cbf9f34489da80 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 15:01:54,803 INFO [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 15:01:54,803 INFO [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-18 15:01:54,803 DEBUG [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1479): Online Regions={14e38e219a88ee77a3cbf9f34489da80=hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80., 1588230740=hbase:meta,,1.1588230740} 2023-02-18 15:01:54,803 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 15:01:54,803 DEBUG [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1505): Waiting on 14e38e219a88ee77a3cbf9f34489da80, 1588230740 2023-02-18 15:01:54,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 15:01:54,803 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 15:01:54,803 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 15:01:54,803 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 15:01:54,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-18 15:01:54,806 DEBUG [RS:0;jenkins-hbase4:36949] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/oldWALs 2023-02-18 15:01:54,806 INFO [RS:0;jenkins-hbase4:36949] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36949%2C1676732509380:(num 1676732510695) 2023-02-18 15:01:54,806 DEBUG [RS:0;jenkins-hbase4:36949] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:54,807 INFO [RS:0;jenkins-hbase4:36949] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:54,807 INFO [RS:0;jenkins-hbase4:36949] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:54,807 INFO [RS:0;jenkins-hbase4:36949] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 15:01:54,807 INFO [RS:0;jenkins-hbase4:36949] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 15:01:54,807 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:54,807 INFO [RS:0;jenkins-hbase4:36949] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 15:01:54,808 INFO [RS:0;jenkins-hbase4:36949] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36949 2023-02-18 15:01:54,810 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:54,810 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:54,810 ERROR [Listener at localhost/43957-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7eb6ae0 rejected from java.util.concurrent.ThreadPoolExecutor@3d4eec5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:54,810 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:54,810 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36949,1676732509380 2023-02-18 15:01:54,810 ERROR [Listener at localhost/43957-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2b3a4499 rejected from java.util.concurrent.ThreadPoolExecutor@3d4eec5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:54,810 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:54,812 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36949,1676732509380] 2023-02-18 15:01:54,812 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36949,1676732509380; numProcessing=1 2023-02-18 15:01:54,813 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/.tmp/info/3a5fab8b1c514789a73e3c629fd26545 2023-02-18 15:01:54,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80/.tmp/info/2aec5130ef0d46c0bd47ad9ccda10828 2023-02-18 15:01:54,813 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36949,1676732509380 already deleted, retry=false 2023-02-18 15:01:54,814 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36949,1676732509380 expired; onlineServers=1 2023-02-18 15:01:54,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a5fab8b1c514789a73e3c629fd26545 2023-02-18 15:01:54,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80/.tmp/info/2aec5130ef0d46c0bd47ad9ccda10828 as hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80/info/2aec5130ef0d46c0bd47ad9ccda10828 2023-02-18 15:01:54,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80/info/2aec5130ef0d46c0bd47ad9ccda10828, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 15:01:54,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 14e38e219a88ee77a3cbf9f34489da80 in 20ms, sequenceid=6, compaction requested=false 2023-02-18 15:01:54,824 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/.tmp/rep_barrier/7ef6233f64a647e3a581c2d60ea7ca64 2023-02-18 15:01:54,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/namespace/14e38e219a88ee77a3cbf9f34489da80/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 15:01:54,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:54,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 14e38e219a88ee77a3cbf9f34489da80: 2023-02-18 15:01:54,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676732509917.14e38e219a88ee77a3cbf9f34489da80. 2023-02-18 15:01:54,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ef6233f64a647e3a581c2d60ea7ca64 2023-02-18 15:01:54,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/.tmp/table/7e6502fdf5534d94a1525222d9b1b826 2023-02-18 15:01:54,842 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e6502fdf5534d94a1525222d9b1b826 2023-02-18 15:01:54,843 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/.tmp/info/3a5fab8b1c514789a73e3c629fd26545 as hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/info/3a5fab8b1c514789a73e3c629fd26545 2023-02-18 15:01:54,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a5fab8b1c514789a73e3c629fd26545 2023-02-18 15:01:54,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/info/3a5fab8b1c514789a73e3c629fd26545, entries=12, sequenceid=21, filesize=6.2 K 2023-02-18 15:01:54,847 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/.tmp/rep_barrier/7ef6233f64a647e3a581c2d60ea7ca64 as hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/rep_barrier/7ef6233f64a647e3a581c2d60ea7ca64 2023-02-18 15:01:54,851 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ef6233f64a647e3a581c2d60ea7ca64 2023-02-18 15:01:54,851 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/rep_barrier/7ef6233f64a647e3a581c2d60ea7ca64, entries=1, sequenceid=21, filesize=5.0 K 2023-02-18 15:01:54,851 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/.tmp/table/7e6502fdf5534d94a1525222d9b1b826 as hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/table/7e6502fdf5534d94a1525222d9b1b826 2023-02-18 15:01:54,854 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e6502fdf5534d94a1525222d9b1b826 2023-02-18 15:01:54,855 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/table/7e6502fdf5534d94a1525222d9b1b826, entries=4, sequenceid=21, filesize=5.0 K 2023-02-18 15:01:54,855 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 52ms, sequenceid=21, compaction requested=false 2023-02-18 15:01:54,858 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 15:01:54,858 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 15:01:54,859 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:54,859 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 15:01:54,859 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 15:01:54,876 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:54,876 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:54,996 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:54,996 INFO [RS:0;jenkins-hbase4:36949] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36949,1676732509380; zookeeper connection closed. 2023-02-18 15:01:54,996 ERROR [Listener at localhost/43957-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@53dcfd8c rejected from java.util.concurrent.ThreadPoolExecutor@3d4eec5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:54,997 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:36949-0x10067f3964f0001, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:54,997 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7d46a206] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7d46a206 2023-02-18 15:01:54,997 ERROR [Listener at localhost/43957-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f9e195e rejected from java.util.concurrent.ThreadPoolExecutor@3d4eec5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:55,003 INFO [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41325,1676732509401; all regions closed. 2023-02-18 15:01:55,006 DEBUG [RS:1;jenkins-hbase4:41325] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/oldWALs 2023-02-18 15:01:55,006 INFO [RS:1;jenkins-hbase4:41325] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41325%2C1676732509401.meta:.meta(num 1676732509862) 2023-02-18 15:01:55,010 DEBUG [RS:1;jenkins-hbase4:41325] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/oldWALs 2023-02-18 15:01:55,010 INFO [RS:1;jenkins-hbase4:41325] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41325%2C1676732509401:(num 1676732510286) 2023-02-18 15:01:55,010 DEBUG [RS:1;jenkins-hbase4:41325] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:55,010 INFO [RS:1;jenkins-hbase4:41325] regionserver.LeaseManager(133): Closed leases 2023-02-18 15:01:55,010 INFO [RS:1;jenkins-hbase4:41325] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 15:01:55,010 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:55,014 INFO [RS:1;jenkins-hbase4:41325] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41325 2023-02-18 15:01:55,016 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41325,1676732509401 2023-02-18 15:01:55,016 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 15:01:55,016 ERROR [Listener at localhost/43957-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e298e8e rejected from java.util.concurrent.ThreadPoolExecutor@7a161593[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:55,017 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41325,1676732509401] 2023-02-18 15:01:55,017 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41325,1676732509401; numProcessing=2 2023-02-18 15:01:55,019 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41325,1676732509401 already deleted, retry=false 2023-02-18 15:01:55,019 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41325,1676732509401 expired; onlineServers=0 2023-02-18 15:01:55,019 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33955,1676732509338' ***** 2023-02-18 15:01:55,019 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 15:01:55,020 DEBUG [M:0;jenkins-hbase4:33955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@622cd3c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 15:01:55,020 INFO [M:0;jenkins-hbase4:33955] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33955,1676732509338 2023-02-18 15:01:55,020 INFO [M:0;jenkins-hbase4:33955] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33955,1676732509338; all regions closed. 2023-02-18 15:01:55,020 DEBUG [M:0;jenkins-hbase4:33955] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 15:01:55,020 DEBUG [M:0;jenkins-hbase4:33955] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 15:01:55,020 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 15:01:55,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732509525] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676732509525,5,FailOnTimeoutGroup] 2023-02-18 15:01:55,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732509525] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676732509525,5,FailOnTimeoutGroup] 2023-02-18 15:01:55,020 DEBUG [M:0;jenkins-hbase4:33955] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 15:01:55,022 INFO [M:0;jenkins-hbase4:33955] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 15:01:55,022 INFO [M:0;jenkins-hbase4:33955] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 15:01:55,022 INFO [M:0;jenkins-hbase4:33955] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 15:01:55,022 DEBUG [M:0;jenkins-hbase4:33955] master.HMaster(1512): Stopping service threads 2023-02-18 15:01:55,022 INFO [M:0;jenkins-hbase4:33955] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 15:01:55,022 ERROR [M:0;jenkins-hbase4:33955] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 15:01:55,023 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 15:01:55,023 INFO [M:0;jenkins-hbase4:33955] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 15:01:55,023 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 15:01:55,023 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 15:01:55,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 15:01:55,023 DEBUG [M:0;jenkins-hbase4:33955] zookeeper.ZKUtil(398): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 15:01:55,023 WARN [M:0;jenkins-hbase4:33955] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 15:01:55,023 INFO [M:0;jenkins-hbase4:33955] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 15:01:55,024 INFO [M:0;jenkins-hbase4:33955] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 15:01:55,024 DEBUG [M:0;jenkins-hbase4:33955] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 15:01:55,024 INFO [M:0;jenkins-hbase4:33955] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:55,024 DEBUG [M:0;jenkins-hbase4:33955] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:55,024 DEBUG [M:0;jenkins-hbase4:33955] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 15:01:55,024 DEBUG [M:0;jenkins-hbase4:33955] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:55,024 INFO [M:0;jenkins-hbase4:33955] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.71 KB heapSize=65.67 KB 2023-02-18 15:01:55,032 INFO [M:0;jenkins-hbase4:33955] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.71 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a4d15b0989b94f3f850aabc09fe48af0 2023-02-18 15:01:55,037 DEBUG [M:0;jenkins-hbase4:33955] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a4d15b0989b94f3f850aabc09fe48af0 as hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a4d15b0989b94f3f850aabc09fe48af0 2023-02-18 15:01:55,040 INFO [M:0;jenkins-hbase4:33955] regionserver.HStore(1080): Added hdfs://localhost:32797/user/jenkins/test-data/d0152726-bf1f-989c-252f-eab334f4b89c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a4d15b0989b94f3f850aabc09fe48af0, entries=17, sequenceid=132, filesize=8.6 K 2023-02-18 15:01:55,041 INFO [M:0;jenkins-hbase4:33955] regionserver.HRegion(2947): Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-18 15:01:55,042 INFO [M:0;jenkins-hbase4:33955] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 15:01:55,042 DEBUG [M:0;jenkins-hbase4:33955] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 15:01:55,044 INFO [M:0;jenkins-hbase4:33955] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 15:01:55,044 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 15:01:55,044 INFO [M:0;jenkins-hbase4:33955] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33955 2023-02-18 15:01:55,045 DEBUG [M:0;jenkins-hbase4:33955] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33955,1676732509338 already deleted, retry=false 2023-02-18 15:01:55,398 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:55,398 INFO [M:0;jenkins-hbase4:33955] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33955,1676732509338; zookeeper connection closed. 2023-02-18 15:01:55,398 ERROR [Listener at localhost/43957-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a6f4ae1 rejected from java.util.concurrent.ThreadPoolExecutor@6e50c374[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:55,399 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): master:33955-0x10067f3964f0000, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:55,399 ERROR [Listener at localhost/43957-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a1b253c rejected from java.util.concurrent.ThreadPoolExecutor@6e50c374[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:55,498 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:55,498 INFO [RS:1;jenkins-hbase4:41325] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41325,1676732509401; zookeeper connection closed. 2023-02-18 15:01:55,498 ERROR [Listener at localhost/43957-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c0eecd2 rejected from java.util.concurrent.ThreadPoolExecutor@7a161593[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:55,498 DEBUG [Listener at localhost/43957-EventThread] zookeeper.ZKWatcher(600): regionserver:41325-0x10067f3964f0002, quorum=127.0.0.1:62548, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 15:01:55,498 ERROR [Listener at localhost/43957-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44116ee1 rejected from java.util.concurrent.ThreadPoolExecutor@7a161593[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 15:01:55,498 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4264fafb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4264fafb 2023-02-18 15:01:55,498 INFO [Listener at localhost/43957] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 15:01:55,499 WARN [Listener at localhost/43957] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:55,502 INFO [Listener at localhost/43957] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:55,606 WARN [BP-153278171-172.31.14.131-1676732508746 heartbeating to localhost/127.0.0.1:32797] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:55,606 WARN [BP-153278171-172.31.14.131-1676732508746 heartbeating to localhost/127.0.0.1:32797] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-153278171-172.31.14.131-1676732508746 (Datanode Uuid 08316784-82f4-441d-bb88-448130619af4) service to localhost/127.0.0.1:32797 2023-02-18 15:01:55,607 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/cluster_7b3762fa-ab87-2406-dcf6-4c35c795d3ad/dfs/data/data3/current/BP-153278171-172.31.14.131-1676732508746] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:55,607 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/cluster_7b3762fa-ab87-2406-dcf6-4c35c795d3ad/dfs/data/data4/current/BP-153278171-172.31.14.131-1676732508746] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:55,609 WARN [Listener at localhost/43957] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 15:01:55,612 INFO [Listener at localhost/43957] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:55,714 WARN [BP-153278171-172.31.14.131-1676732508746 heartbeating to localhost/127.0.0.1:32797] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 15:01:55,714 WARN [BP-153278171-172.31.14.131-1676732508746 heartbeating to localhost/127.0.0.1:32797] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-153278171-172.31.14.131-1676732508746 (Datanode Uuid 95c7cca4-9633-4674-858c-0b5477aa1053) service to localhost/127.0.0.1:32797 2023-02-18 15:01:55,714 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/cluster_7b3762fa-ab87-2406-dcf6-4c35c795d3ad/dfs/data/data1/current/BP-153278171-172.31.14.131-1676732508746] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:55,715 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ccc96ad-fca9-524d-7e71-62aeebb69e8d/cluster_7b3762fa-ab87-2406-dcf6-4c35c795d3ad/dfs/data/data2/current/BP-153278171-172.31.14.131-1676732508746] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 15:01:55,729 INFO [Listener at localhost/43957] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 15:01:55,841 INFO [Listener at localhost/43957] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 15:01:55,858 INFO [Listener at localhost/43957] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 15:01:55,870 INFO [Listener at localhost/43957] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=293 (was 273) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:32797 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,33955,1676732509338)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:32797 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:32797 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:32797 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43957 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:32797 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:32797 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:32797 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=599 (was 571) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=379 (was 342) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 171), AvailableMemoryMB=9500 (was 8520) - AvailableMemoryMB LEAK? -